-- Logs begin at Fri 2022-09-09 01:00:30 UTC, end at Fri 2022-09-09 02:14:59 UTC. -- Sep 09 01:39:56.583749 dv-cinder-852210-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 01:39:56.593014 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 01:39:56 2022] *** Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: nodename: dv-cinder-852210-12-iscsi Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: machine: x86_64 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: clock source: unix Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: pcre jit disabled Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: detected number of CPU cores: 4 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: current working directory: / Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: detected binary path: /usr/bin/uwsgi-core Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: your processes number limit is 47680 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: your memory page size is 4096 bytes Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: detected max file descriptor number: 2048 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: lock engine: pthread robust mutexes Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: thunder lock: enabled Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 01:39:56.596115 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 01:39:56.633856 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: Python main interpreter initialized at 0x55d25dd219c0 Sep 09 01:39:56.633856 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: python threads support enabled Sep 09 01:39:56.633856 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: your server socket listen backlog is limited to 100 connections Sep 09 01:39:56.633856 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: your mercy for graceful operations on workers is 90 seconds Sep 09 01:39:56.634191 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 01:39:56.634271 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: *** Operational MODE: preforking *** Sep 09 01:39:56.634511 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: *** uWSGI is running in multiple interpreter mode *** Sep 09 01:39:56.634511 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: spawned uWSGI master process (pid: 111894) Sep 09 01:39:56.634696 dv-cinder-852210-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 01:39:56.635312 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: spawned uWSGI worker 1 (pid: 111895, cores: 1) Sep 09 01:39:56.635602 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: spawned uWSGI worker 2 (pid: 111896, cores: 1) Sep 09 01:39:56.635695 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 01:39:57.305126 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 01:39:57.315198 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 01:39:58.381999 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:39:58.381999 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: from cryptography.utils import int_from_bytes Sep 09 01:39:58.382619 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:39:58.382619 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: from cryptography.utils import int_from_bytes Sep 09 01:39:58.385560 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:39:58.385560 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: from cryptography.utils import int_from_bytes Sep 09 01:39:58.385977 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:39:58.385977 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: from cryptography.utils import int_from_bytes Sep 09 01:40:00.844662 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 01:40:00.845356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 01:40:00.845454 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 01:40:00.845454 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 01:40:00.845835 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 01:40:00.845835 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 01:40:00.845982 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 01:40:00.846055 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 01:40:00.846167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 01:40:00.846424 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.846535 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 01:40:00.846743 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.846860 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847062 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847304 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847387 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847626 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847739 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.847942 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848030 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848269 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848354 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848574 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848661 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.848996 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.849186 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.849357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.849595 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.849744 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.849910 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-12-iscsi {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850086 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850230 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850503 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850598 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850831 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.850954 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.851165 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.851419 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-12-iscsi {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.851513 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.851756 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.851851 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.852064 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.852275 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.852578 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.853254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.853467 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.853654 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.853827 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.853995 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854170 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854170 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854521 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854691 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854691 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854894 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.854997 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.855154 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.855478 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.855786 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.856196 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-12-iscsi {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.856503 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.856826 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.857673 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.858101 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.858410 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.858721 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.859042 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.859365 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.859672 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.859999 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.860317 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.860638 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.860954 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.861282 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.861593 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.861694 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.861904 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862101 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862221 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862528 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862627 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862831 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.862984 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.863069 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.863376 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.863470 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.863697 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.863871 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864016 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864297 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864381 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864578 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864755 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.864849 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865157 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865248 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865479 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865582 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865787 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.865873 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866091 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866257 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-12-iscsi {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866397 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866572 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866703 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.866933 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867038 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867196 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867283 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867592 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867687 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867898 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.867995 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868202 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868301 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868519 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868605 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868839 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.868938 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869169 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869259 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869495 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869582 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869810 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.869910 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870129 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870216 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870435 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870595 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870774 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.870894 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871092 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871189 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871400 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871486 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871719 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.871813 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872041 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872134 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872347 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872433 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872609 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.872695 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.873509 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.873615 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.873831 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.873917 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874149 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874236 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874470 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874557 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874722 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874815 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.874969 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875056 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875291 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875385 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875608 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875704 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.875914 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876000 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876220 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876306 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876522 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876615 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876821 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.876906 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877147 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877246 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877451 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877552 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877753 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.877838 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878154 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878368 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878454 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878675 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.878763 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879241 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879334 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879545 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879630 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879846 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.879932 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880152 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880298 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880470 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880558 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880789 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.880882 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881114 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881205 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881425 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881559 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881732 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.881820 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882038 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882132 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882361 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882448 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882667 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882760 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.882974 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883060 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883296 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883391 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883603 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883755 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.883906 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884232 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884366 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884535 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884705 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884835 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.884957 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885171 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885300 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885471 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885611 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885777 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.885899 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886095 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886241 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886547 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886701 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.886815 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887005 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887269 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887370 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887597 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887730 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.887902 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888210 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888363 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888536 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888673 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888835 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.888979 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.889176 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.889306 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.889498 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.889728 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.889831 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890099 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890193 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890402 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890590 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890719 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.890883 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.891055 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.891207 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.891386 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.891526 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.891737 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.891904 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.892029 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.892210 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.892365 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.892647 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.892863 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.893133 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.893266 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.893464 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.893591 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.893779 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.893918 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.894089 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.894222 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.894484 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.894629 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.894744 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.894870 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.894994 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.895126 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.895309 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.895427 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.895631 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.895866 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.895958 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.896177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.896268 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.896511 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.896603 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.896779 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.896865 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.897102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.897191 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.897427 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.897542 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.897731 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.897819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.898034 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.898135 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.898342 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.898508 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.898656 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.898795 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.898934 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.899070 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.899217 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.899369 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.899514 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.899658 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.899791 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.899968 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.900066 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.900280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.900368 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.900590 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.900676 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.900901 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.901006 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.901269 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.901360 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.901580 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.901713 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.901891 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.901990 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:40:00.902209 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.902295 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.902520 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.902615 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.902841 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.902937 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903151 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903238 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903460 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903546 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903769 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.903857 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904105 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904192 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904416 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904502 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904729 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.904816 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905050 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905178 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905384 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905469 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905696 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.905783 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906004 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906097 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906316 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906403 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906627 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906729 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.906937 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907026 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907246 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907342 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907551 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907658 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907852 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.907940 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908152 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908255 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908462 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908548 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908763 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.908851 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909097 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909205 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909410 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909496 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909718 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.909812 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910048 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910144 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910353 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910440 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910661 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910756 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.910971 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911059 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911279 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911376 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911579 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911673 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911884 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.911972 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912190 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912283 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912492 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912579 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912815 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.912912 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913146 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913234 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913452 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913539 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913770 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.913857 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914070 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914156 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914375 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914600 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914714 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914826 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.914981 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915110 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915290 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915412 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915603 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915728 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.915913 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916042 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916230 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916352 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916537 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916650 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916843 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.916956 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917182 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917319 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917495 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917693 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917817 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.917934 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918098 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918215 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918399 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918513 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918701 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.918814 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.919003 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.919118 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.919311 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.919424 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920132 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920234 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920436 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920523 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920740 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.920835 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921048 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921156 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921372 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921461 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921676 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921762 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.921979 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922068 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922283 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922379 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922587 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922674 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922886 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.922982 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923197 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923283 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923495 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923596 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923798 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.923902 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924093 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924179 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924408 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924495 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924709 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.924810 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925028 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925159 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925353 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925452 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925663 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925751 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.925976 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926071 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926287 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926373 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926600 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926688 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926907 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.926999 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927214 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927308 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927527 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927615 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927834 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.927933 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928138 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928225 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928446 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928532 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928772 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.928858 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929085 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929173 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929413 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929501 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929724 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.929871 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930035 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930190 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930325 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930460 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930628 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930764 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.930929 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931074 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931231 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931367 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931535 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931625 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931843 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.931944 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932144 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932231 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932444 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932537 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932742 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.932841 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933040 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933147 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933366 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933453 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933673 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933772 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.933976 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934061 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934275 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934361 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934660 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934871 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.934957 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.935211 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.935791 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936057 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936149 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936378 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936473 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936685 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.936771 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937000 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937108 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937342 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937440 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937655 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937751 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.937970 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938068 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938272 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938358 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938581 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938675 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938889 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.938975 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939193 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939279 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939502 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939603 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939808 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.939901 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940110 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940196 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940416 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940511 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940730 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.940815 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941031 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941209 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941366 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941470 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941664 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941753 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.941975 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942060 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942283 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942373 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942584 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942671 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942888 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.942974 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943198 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943293 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943512 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943605 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943817 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.943903 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944122 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944208 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944431 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944530 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944733 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.944819 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945036 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945162 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945372 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945466 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945678 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945782 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.945981 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946068 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946284 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946371 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946586 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946682 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946889 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.946981 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947203 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947288 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947503 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947597 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947815 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.947908 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948134 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948232 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948444 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948541 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948752 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.948837 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949083 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949171 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949391 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949480 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949695 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.949827 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950001 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950088 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950307 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950394 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950606 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.950701 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.951442 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.951540 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.951749 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.951840 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952059 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952145 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952362 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952447 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952668 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952763 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.952971 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953080 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953307 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953411 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953614 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953701 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953911 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.953997 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.954213 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.954308 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.954519 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.954788 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.954882 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955119 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955205 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955434 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955520 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955748 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.955835 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956048 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956135 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956348 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956448 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956665 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956753 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.956972 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957113 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957298 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957398 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957599 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957687 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957900 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.957985 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958215 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958322 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958517 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958606 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958818 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.958902 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959120 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959207 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959424 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959511 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959728 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.959818 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960035 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960131 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960337 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960436 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960638 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960732 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.960943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961030 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961272 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961360 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961579 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961666 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961881 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.961971 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962184 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962277 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962484 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962579 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962791 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.962876 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963098 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963183 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963401 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963495 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963704 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.963799 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964006 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964091 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964306 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964402 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964630 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964718 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.964925 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965011 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965294 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965514 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965634 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965850 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.965936 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.966164 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.966264 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.966529 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967126 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967370 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967468 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967670 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967765 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.967972 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968060 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968285 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968406 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968593 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968707 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968892 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.968988 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969224 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969319 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969524 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969609 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969826 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.969931 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970134 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970280 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970420 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970556 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970715 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.970858 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971000 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971136 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971272 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971415 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971559 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971696 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971860 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.971992 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972170 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972313 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972450 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972603 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972740 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.972876 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973038 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973201 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973371 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973458 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973667 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973753 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.973981 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974075 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974284 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974370 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974582 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974675 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974879 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.974965 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975179 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975265 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975483 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975568 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975785 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.975874 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976109 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976203 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976418 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976512 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976720 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.976807 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977022 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977147 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977351 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977455 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977653 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977748 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.977954 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978040 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978363 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978555 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978653 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978855 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.978942 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979159 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979256 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979459 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979566 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979760 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.979846 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980061 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980156 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980363 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980459 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980663 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980748 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.980960 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981055 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981288 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981376 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981585 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981671 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.981885 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982031 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982211 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982344 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982507 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982600 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982805 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.982894 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983110 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983412 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983498 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983708 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.983803 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984014 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984101 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984311 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984412 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984621 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984716 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.984921 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985014 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985244 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985347 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985545 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985639 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985853 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.985948 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986158 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986254 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986457 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986543 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986764 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.986853 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987068 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987162 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987368 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987462 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987666 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987762 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.987967 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988062 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988264 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988349 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988568 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988703 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988866 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.988964 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989204 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989294 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989516 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989604 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989816 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.989912 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990122 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990209 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990422 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990512 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990722 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.990810 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991023 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991117 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991326 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991413 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991622 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991717 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.991920 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992007 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992219 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992315 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992516 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992604 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992813 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.992899 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993142 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993248 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993454 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993541 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993759 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.993854 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994055 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994149 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994354 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994449 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994654 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994740 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.994975 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995141 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995283 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995370 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995585 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995680 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995891 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.995979 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996192 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996279 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996500 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996595 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996806 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.996894 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997141 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997243 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997449 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997537 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997787 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.997882 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998095 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998181 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998407 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998493 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998711 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.998798 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999013 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999099 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999417 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999641 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999728 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:00.999949 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000057 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000267 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000363 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000585 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000681 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000905 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.000992 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001231 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001332 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001542 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001630 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001846 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.001939 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002150 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002248 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002457 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002549 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002758 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.002846 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003060 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003160 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003367 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003454 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003667 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.003760 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004232 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004325 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004546 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004632 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004852 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.004938 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005182 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005497 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005650 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005799 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.005963 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006120 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006429 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006595 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006731 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.006914 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007038 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007238 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007324 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007543 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007632 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007857 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.007945 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008168 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008331 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008493 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008642 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008823 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.008950 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009157 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009281 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009473 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009589 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009778 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.009897 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010099 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010208 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010421 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010549 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010734 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.010825 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011058 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011202 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011468 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011569 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011788 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.011901 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012094 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012183 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012392 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012487 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012692 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012789 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.012999 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.013107 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.013852 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.013980 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014154 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014255 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014481 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014594 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014753 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.014841 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015073 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015168 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015372 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015457 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015680 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015774 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.015990 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016086 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016298 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016385 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016598 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016691 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.016900 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017103 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017248 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017390 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017550 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017697 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.017872 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018015 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018185 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018332 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018506 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018653 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018831 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.018957 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019134 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019268 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019454 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019577 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019760 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.019899 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020064 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020219 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020366 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020527 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020657 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020839 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.020993 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021191 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021328 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021473 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021648 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021794 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.021975 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022106 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022302 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022445 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022614 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022817 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.022943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023137 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023270 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023446 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023571 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023762 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.023904 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024085 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024187 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024386 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024503 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024686 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024807 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.024995 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025133 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025322 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025431 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025625 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025737 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.025943 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026041 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026245 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026341 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026552 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026639 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026857 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.026952 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027164 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027252 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027466 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027559 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027767 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.027854 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028084 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028170 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028382 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028474 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028700 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.028788 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.029555 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.029650 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.029875 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.029974 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030179 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030268 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030519 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030606 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030825 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.030922 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031152 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031241 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031457 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031551 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031761 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.031858 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032064 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032152 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032375 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032511 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032692 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.032789 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033005 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033112 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033348 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033448 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033666 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033763 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.033971 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034057 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034276 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034362 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034592 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034702 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034908 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.034996 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.035215 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.035300 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.035535 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.035730 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.035858 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036059 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036147 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036373 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036474 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036686 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036781 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.036998 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037115 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037336 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037432 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037637 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037724 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.037943 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038038 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038241 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038329 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038541 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038628 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038841 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.038927 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039161 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039248 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039460 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039546 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039778 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.039864 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040082 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040169 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040381 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040467 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040681 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040768 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.040980 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041090 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041331 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041419 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041629 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041729 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.041956 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042043 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042262 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042350 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042572 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042734 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042884 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.042980 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043194 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043280 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043501 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043588 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043809 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.043895 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044117 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044211 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044425 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044513 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044757 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.044842 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045112 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045203 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045400 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045487 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045709 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.045796 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046020 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046106 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046350 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046533 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046668 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046857 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.046979 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.047168 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.047291 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.047476 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.047605 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.047784 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048095 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048192 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048405 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048501 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048714 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.048800 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049021 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049140 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049354 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049452 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049663 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049752 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.049985 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050073 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050298 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050385 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050604 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050691 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050910 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.050999 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051219 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051306 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051525 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051620 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051829 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.051925 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052135 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052221 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052446 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052542 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052751 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.052847 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053111 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053204 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053398 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053503 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053709 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.053926 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054014 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054275 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054370 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054590 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054679 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054901 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.054994 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055209 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055309 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055609 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055828 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.055913 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056137 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056237 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056440 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056526 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056746 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.056842 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057079 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057182 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057393 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057480 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057695 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057784 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.057998 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058094 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058305 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058391 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058617 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058819 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.058915 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059132 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059219 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059460 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059547 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059780 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.059880 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060097 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060204 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060431 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060524 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060732 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.060828 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061042 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061172 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061365 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061452 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061666 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061762 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.061971 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062058 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062270 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062369 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062567 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062662 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062868 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.062964 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063174 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063261 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063468 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063556 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063774 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.063859 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064076 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064161 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064416 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064606 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064718 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.064953 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065048 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065292 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065400 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065623 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065711 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.065939 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066026 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066247 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066336 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066548 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066634 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066860 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.066946 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067161 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067248 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067463 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067550 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067775 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.067870 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068084 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068316 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068405 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068655 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068742 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.068966 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069053 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069297 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069397 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069599 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069690 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069906 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.069995 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070207 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070295 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070508 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070601 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070819 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.070905 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071122 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071208 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071422 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071518 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071730 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.071825 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072027 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072119 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072327 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072423 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072629 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072717 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.072926 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073021 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073258 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073361 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073559 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073655 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073868 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.073957 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074166 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074261 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074470 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074563 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074779 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.074866 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.075086 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.075181 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.075396 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.075492 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.075718 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.076339 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.076556 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.076645 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.076859 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.076946 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.077194 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.077285 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.077504 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.077593 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078020 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078113 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078204 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078285 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078376 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078457 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078690 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.078778 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079004 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079092 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079330 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079580 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079668 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.079914 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080009 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080234 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080566 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080652 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080886 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.080981 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081213 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081366 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081519 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081614 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081821 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.081915 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082145 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082242 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082457 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082544 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082767 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.082854 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083076 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083179 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083384 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083470 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083688 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083774 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.083995 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084086 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084303 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084435 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084610 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084704 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.084916 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085004 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085245 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085345 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085553 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085650 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085860 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.085947 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086169 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086254 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086476 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086570 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086780 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.086881 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087084 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087172 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087394 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087491 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087699 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.087793 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088004 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088093 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088309 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088397 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088612 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088698 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.088917 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089012 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089245 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089333 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089549 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089634 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089852 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.089940 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090155 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090243 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090457 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090545 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090758 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.090844 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.091063 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.091365 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.091450 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092222 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092312 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092525 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092614 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092828 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.092923 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093156 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093253 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093485 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093576 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093816 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.093910 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094124 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094220 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094443 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094538 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094797 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.094889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095075 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095171 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095384 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095470 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095704 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.095790 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096023 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096125 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096331 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096425 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096635 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096720 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.096934 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097029 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097275 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097365 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097584 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097670 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097889 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.097985 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098193 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098281 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098496 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098590 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098803 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.098892 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099104 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099198 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099404 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099490 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099705 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.099797 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100006 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100093 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100314 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100401 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100613 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100702 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.100913 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101000 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101237 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101342 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101540 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101637 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101839 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.101926 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102140 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102240 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102454 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102540 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102753 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.102839 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103053 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103149 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103353 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103448 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103651 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103739 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.103951 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104047 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104263 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104359 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104577 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104665 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104892 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.104979 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105235 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105324 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105542 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105630 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105860 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.105948 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106171 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106257 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106490 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106584 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106809 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.106897 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107178 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107277 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107504 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107601 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107815 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.107901 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.108126 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.108212 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.108430 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.108590 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.108681 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 01:40:01.108761 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.109031 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.109364 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.109672 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.109998 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.110320 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.110623 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.110943 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.111256 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.111573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.111886 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.112196 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.112521 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.112829 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.113164 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.113476 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.113785 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.114090 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.114412 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.114703 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.115011 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.115326 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.115640 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.115975 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.116299 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.116607 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.116927 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.117280 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.117628 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.117938 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.118278 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.118605 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.118917 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.119225 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.119529 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:40:01.119769 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 01:40:01.265569 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO dbcounter [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Registered counter for database nova_api Sep 09 01:40:01.274729 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO dbcounter [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Registered counter for database nova_api Sep 09 01:40:01.286648 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.293213 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writer thread running {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.295358 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.301718 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writer thread running {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.350107 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.context [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43400d51-3c7d-455c-8c25-cdb5e9eccfe4(cell1) {{(pid=111896) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 01:40:01.354187 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:40:01.354659 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:40:01.356193 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:40:01.356902 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:40:01.357932 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:40:01.358763 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.context [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43400d51-3c7d-455c-8c25-cdb5e9eccfe4(cell1) {{(pid=111895) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 01:40:01.359916 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:40:01.361943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO dbcounter [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Registered counter for database nova_cell0 Sep 09 01:40:01.362753 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:40:01.363221 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:40:01.364760 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:40:01.365495 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:40:01.365950 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:40:01.366095 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO dbcounter [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Registered counter for database nova_cell1 Sep 09 01:40:01.367911 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_concurrency.lockutils [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:40:01.370204 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO dbcounter [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Registered counter for database nova_cell0 Sep 09 01:40:01.373503 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.374366 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO dbcounter [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Registered counter for database nova_cell1 Sep 09 01:40:01.375664 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.380520 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writer thread running {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.381667 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.385181 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.388516 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writer thread running {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.519573 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writer thread running {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.528410 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writer thread running {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.529668 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO dbcounter [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Registered counter for database nova_cell0 Sep 09 01:40:01.536554 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_db.sqlalchemy.engines [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.537560 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO dbcounter [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Registered counter for database nova_cell0 Sep 09 01:40:01.541409 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writer thread running {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.546466 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:40:01.550971 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writer thread running {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:40:01.876899 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: WARNING keystonemiddleware.auth_token [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:40:01.877494 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: WARNING keystonemiddleware.auth_token [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:40:01.884465 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: WARNING keystonemiddleware.auth_token [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:40:01.884685 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: WARNING keystonemiddleware.auth_token [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:40:02.224736 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: WARNING keystonemiddleware.auth_token [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:40:02.230649 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: WARNING keystonemiddleware.auth_token [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:40:02.234930 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: WARNING keystonemiddleware.auth_token [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:40:02.236424 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d25dd219c0 pid: 111896 (default app) Sep 09 01:40:02.238519 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:40:02.239716 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 09 01:40:02.240127 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Fri Sep 9 01:40:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:40:02.240856 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: WARNING keystonemiddleware.auth_token [None req-9ee5165b-dc62-4391-8288-2e4c99a5f95c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:40:02.246259 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d25dd219c0 pid: 111895 (default app) Sep 09 01:41:22.493706 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:22.495182 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Sep 09 01:41:22.495748 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:22.513864 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_api:SELECT=3 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:22.514987 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_cell0:SELECT=3 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:22.515867 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_cell1:SELECT=3 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:22.516719 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:23.385697 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-2a63d35a-7659-401a-a159-6b88ff2cb156 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:23.418204 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-2a63d35a-7659-401a-a159-6b88ff2cb156 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915573 Sep 09 01:41:23.419087 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 01:41:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:26.021606 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:26.022600 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-3ad0f377-e60d-497c-a8cd-4aed3907261b None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 09 01:41:26.023285 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:26.476392 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-f6de5e8e-eeff-4348-a68b-b342e66b2730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:26.525156 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-f6de5e8e-eeff-4348-a68b-b342e66b2730 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495795 Sep 09 01:41:26.525732 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:41:26.539421 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_api:SELECT=3 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:26.540232 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_cell1:SELECT=3 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:26.541770 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_cell0:SELECT=3 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:26.542725 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:26.750246 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-97d364f3-b79d-4128-b9d1-e497ac370eaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:26.819626 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-97d364f3-b79d-4128-b9d1-e497ac370eaf admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285073 Sep 09 01:41:26.819883 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 01:41:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:41:29.426206 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-f6de5e8e-eeff-4348-a68b-b342e66b2730 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:29.427214 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-f6de5e8e-eeff-4348-a68b-b342e66b2730 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 01:41:29.427614 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:30.090964 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-8cfedd8d-2d19-45ab-8b4e-868914c09907 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:30.134709 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-8cfedd8d-2d19-45ab-8b4e-868914c09907 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700789 Sep 09 01:41:30.135654 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:30.148051 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-9335338a-63ba-4471-9931-462ab5d18375 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:30.188725 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-9335338a-63ba-4471-9931-462ab5d18375 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044454 Sep 09 01:41:30.189362 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 01:41:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:32.804981 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-8cfedd8d-2d19-45ab-8b4e-868914c09907 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:32.806076 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-8cfedd8d-2d19-45ab-8b4e-868914c09907 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 09 01:41:32.806489 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:33.238213 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-020b07c0-c88d-4db4-9845-02133f18c9ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:33.258147 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-020b07c0-c88d-4db4-9845-02133f18c9ca admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445757 Sep 09 01:41:33.258698 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:41:33.274307 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-39fc6d79-6297-4671-ac1f-a4e196d13527 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:33.302062 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-39fc6d79-6297-4671-ac1f-a4e196d13527 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031438 Sep 09 01:41:33.302568 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 01:41:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:41:36.064781 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-020b07c0-c88d-4db4-9845-02133f18c9ca admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:36.066492 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-020b07c0-c88d-4db4-9845-02133f18c9ca admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002536 Sep 09 01:41:36.067192 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:36.542864 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-fa19de1f-e060-4423-a9bc-fc1417478f2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:36.568672 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-fa19de1f-e060-4423-a9bc-fc1417478f2f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491081 Sep 09 01:41:36.570110 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:36.591786 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-6b52317b-50fa-471a-a250-c3dbdcbacede admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:36.627571 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-6b52317b-50fa-471a-a250-c3dbdcbacede admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043323 Sep 09 01:41:36.628431 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 01:41:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:39.285204 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-fa19de1f-e060-4423-a9bc-fc1417478f2f admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:39.286143 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-fa19de1f-e060-4423-a9bc-fc1417478f2f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 09 01:41:39.286550 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:39.738365 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:39.758026 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464930 Sep 09 01:41:39.759298 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:41:39.771353 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c9a83ae3-c57b-4e76-982c-15c166325309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:39.800858 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-c9a83ae3-c57b-4e76-982c-15c166325309 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032960 Sep 09 01:41:39.801822 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Sep 9 01:41:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:42.467286 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:42.468229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 01:41:42.468640 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:42.886041 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-072ddff7-7e82-4e33-bd9e-ad22a34c0443 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:42.912269 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-072ddff7-7e82-4e33-bd9e-ad22a34c0443 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437504 Sep 09 01:41:42.912820 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 01:41:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:41:45.544896 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:45.545948 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-d6a5bb08-5c99-468c-80f5-e091b339bd7b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 09 01:41:45.546353 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:45.953646 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-b9c0afe2-aeaf-4e4c-b060-70c03eba7f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:45.972547 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-b9c0afe2-aeaf-4e4c-b060-70c03eba7f56 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420125 Sep 09 01:41:45.973011 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:45.985730 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-f4a16e87-ab23-4ef5-9ac3-68c6f9fb1aac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:46.013729 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-f4a16e87-ab23-4ef5-9ac3-68c6f9fb1aac admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031945 Sep 09 01:41:46.014328 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 01:41:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:48.626359 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-b9c0afe2-aeaf-4e4c-b060-70c03eba7f56 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:48.627497 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-b9c0afe2-aeaf-4e4c-b060-70c03eba7f56 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 09 01:41:48.628144 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:48.996009 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-4037473c-3562-4345-9d19-c5f6268a0286 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:49.015597 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-4037473c-3562-4345-9d19-c5f6268a0286 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.380535 Sep 09 01:41:49.016156 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:49.028222 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c6abd3f8-681a-42c8-a4f8-13ea00d7c5bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:49.051662 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-c6abd3f8-681a-42c8-a4f8-13ea00d7c5bb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027207 Sep 09 01:41:49.052330 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 01:41:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:51.764047 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-4037473c-3562-4345-9d19-c5f6268a0286 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:51.766379 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-4037473c-3562-4345-9d19-c5f6268a0286 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002996 Sep 09 01:41:51.767108 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:52.243083 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c8a09671-1406-46d8-8602-7907253e6148 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:52.272347 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-c8a09671-1406-46d8-8602-7907253e6148 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.498817 Sep 09 01:41:52.273084 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:41:52.285415 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-565e2a91-cba7-454e-a3cd-308ec32c2f1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:52.316288 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-565e2a91-cba7-454e-a3cd-308ec32c2f1d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034460 Sep 09 01:41:52.316937 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 01:41:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:41:54.987197 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c8a09671-1406-46d8-8602-7907253e6148 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:54.988860 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-c8a09671-1406-46d8-8602-7907253e6148 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Sep 09 01:41:54.989433 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:55.424292 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-a7ac0ca5-521f-4a49-aea8-0a8dfe7682e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "name": "m1.large"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:55.430408 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:55.448865 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-a7ac0ca5-521f-4a49-aea8-0a8dfe7682e1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452868 Sep 09 01:41:55.456747 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:55.462342 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-bb53bfe3-937f-40c4-aa5f-c96dba288f68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:55.488576 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-bb53bfe3-937f-40c4-aa5f-c96dba288f68 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030529 Sep 09 01:41:55.489548 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 01:41:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:41:58.134410 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-a7ac0ca5-521f-4a49-aea8-0a8dfe7682e1 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:41:58.135425 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-a7ac0ca5-521f-4a49-aea8-0a8dfe7682e1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 01:41:58.135838 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:41:58.603043 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:58.610192 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:41:58.626034 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.483906 Sep 09 01:41:58.629220 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Sep 9 01:41:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:41:58.639765 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-e65e7dc5-cf54-40d2-bb85-e19bfe50212d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:41:58.667916 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-e65e7dc5-cf54-40d2-bb85-e19bfe50212d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031867 Sep 09 01:41:58.668900 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Sep 9 01:41:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:42:15.524564 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:15.525634 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 09 01:42:15.526020 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:15.536531 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:42:15.921656 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-9ed89cc5-8b06-4da4-b7e0-dbd3a4f7a9c5 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:15.940758 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-9ed89cc5-8b06-4da4-b7e0-dbd3a4f7a9c5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408722 Sep 09 01:42:15.941333 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 01:42:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:42:17.247502 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:17.248537 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ffba2688-5af4-4746-99c7-d253da62fb7d admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 09 01:42:17.248941 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:17.766089 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c0bbff66-dbb5-4a4f-ae66-ee6264b17643 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:17.771350 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.wsgi [None req-c0bbff66-dbb5-4a4f-ae66-ee6264b17643 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c0bbff66-dbb5-4a4f-ae66-ee6264b17643 admin admin] Request method failure captured: Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept: application/json Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept-Encoding: gzip, deflate Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Connection: keep-alive Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Content-Length: 0 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Host: 10.222.0.15 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-System-Scope: None Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: User-Agent: python-novaclient Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Auth-Token: gAAAAABjGpn5bj4o33fBGNsVRxBKc21cR6ETCiWFyeYgJiFHfhqdcLy3CuQOpoHsiz-Um6JarWAgnHndJotAU_zb3YDpoCtqYeEstrxhoW8kQ4uhilaGgtgZ3FpG5e9uVHnIkMW4DZP77WqxYQ2WI_Fu0tNQZMFrkF1bMhfYmirsizI3BCoBico Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Id: None Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Name: None Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Identity-Status: Confirmed Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Is-Admin-Project: True Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Id: default Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Name: Default Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Name: admin Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Role: reader,admin,member Sep 09 01:42:17.774646 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Roles: reader,admin,member Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant: admin Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Name: admin Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User: admin Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Id: default Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Name: Default Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Name: admin Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: method: > Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: exception: Flavor 42 could not be found. Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: action_args: {'id': '42'} Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:17.776252 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:17.777177 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.778330 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c0bbff66-dbb5-4a4f-ae66-ee6264b17643 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:17.779397 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-c0bbff66-dbb5-4a4f-ae66-ee6264b17643 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388164 Sep 09 01:42:17.779397 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 01:42:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 01:42:17.785756 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-24eaefe8-a7e7-41e7-b61b-e30f48f7f5ff admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:17.810014 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-24eaefe8-a7e7-41e7-b61b-e30f48f7f5ff admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027690 Sep 09 01:42:17.810566 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:42:17.821805 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-0ce319a5-7657-4cb8-9f26-553f0cdf5f44 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:17.843511 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-0ce319a5-7657-4cb8-9f26-553f0cdf5f44 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026808 Sep 09 01:42:17.844054 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:42:17.853288 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-49ebeae5-37d0-43f3-9366-b9475b468a1c admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:17.858506 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.wsgi [None req-49ebeae5-37d0-43f3-9366-b9475b468a1c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-49ebeae5-37d0-43f3-9366-b9475b468a1c admin admin] Request method failure captured: Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept: application/json Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept-Encoding: gzip, deflate Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Connection: keep-alive Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Content-Length: 0 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Host: 10.222.0.15 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-System-Scope: None Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: User-Agent: python-novaclient Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Auth-Token: gAAAAABjGpn5bj4o33fBGNsVRxBKc21cR6ETCiWFyeYgJiFHfhqdcLy3CuQOpoHsiz-Um6JarWAgnHndJotAU_zb3YDpoCtqYeEstrxhoW8kQ4uhilaGgtgZ3FpG5e9uVHnIkMW4DZP77WqxYQ2WI_Fu0tNQZMFrkF1bMhfYmirsizI3BCoBico Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Id: None Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Name: None Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Identity-Status: Confirmed Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Is-Admin-Project: True Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Id: default Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Name: Default Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Name: admin Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Role: reader,admin,member Sep 09 01:42:17.861943 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Roles: reader,admin,member Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant: admin Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Name: admin Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User: admin Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Id: default Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Name: Default Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Name: admin Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: method: > Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: exception: Flavor 42 could not be found. Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: action_args: {'id': '42'} Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:17.863357 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:17.864183 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:17.865522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-49ebeae5-37d0-43f3-9366-b9475b468a1c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:17.867256 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-49ebeae5-37d0-43f3-9366-b9475b468a1c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013597 Sep 09 01:42:17.867256 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 01:42:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 01:42:19.068057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-0ce319a5-7657-4cb8-9f26-553f0cdf5f44 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:19.069100 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-0ce319a5-7657-4cb8-9f26-553f0cdf5f44 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 01:42:19.070011 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:42:19.598409 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c0738e2b-f68b-4db3-9803-1ff7415970fb admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:19.603406 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.wsgi [None req-c0738e2b-f68b-4db3-9803-1ff7415970fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c0738e2b-f68b-4db3-9803-1ff7415970fb admin admin] Request method failure captured: Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept: application/json Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept-Encoding: gzip, deflate Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Connection: keep-alive Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Content-Length: 0 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Host: 10.222.0.15 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-System-Scope: None Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: User-Agent: python-novaclient Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Auth-Token: gAAAAABjGpn6X4ZWEjh7ufINId41rOdUZkcA_cu3_uDsmO-QBbmgskZqiPFWZc7RM5PBGfkk9O9b1m0_PW-nGtkqUfWvy0nZvndxWXVskn4KoGQtELryJRZaNRErhcD_9DRb_qyZkuUqj24zNfR4mN1bOGIC11VSfuaVyCCcPhpCGERUSgeXlbo Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Id: None Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Name: None Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Identity-Status: Confirmed Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Is-Admin-Project: True Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Id: default Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Name: Default Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Name: admin Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Role: reader,admin,member Sep 09 01:42:19.604889 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Roles: reader,admin,member Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant: admin Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Name: admin Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User: admin Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Id: default Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Name: Default Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Name: admin Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: method: > Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: exception: Flavor 84 could not be found. Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: action_args: {'id': '84'} Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:19.606399 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:19.607280 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.608480 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-c0738e2b-f68b-4db3-9803-1ff7415970fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:19.609734 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-c0738e2b-f68b-4db3-9803-1ff7415970fb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395597 Sep 09 01:42:19.609734 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 01:42:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 01:42:19.616149 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-a5b62ae4-a44a-486f-8005-36a9d5ac86bd admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:19.631128 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-a5b62ae4-a44a-486f-8005-36a9d5ac86bd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018553 Sep 09 01:42:19.632137 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:42:19.641337 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ac680cfc-6455-402b-acb2-74cbe76076b4 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:19.656828 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ac680cfc-6455-402b-acb2-74cbe76076b4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018968 Sep 09 01:42:19.657387 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:42:19.666375 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c6fd2798-2fcd-4bb2-a6c8-9f592541da9f admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:19.671160 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.wsgi [None req-c6fd2798-2fcd-4bb2-a6c8-9f592541da9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c6fd2798-2fcd-4bb2-a6c8-9f592541da9f admin admin] Request method failure captured: Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept: application/json Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept-Encoding: gzip, deflate Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Connection: keep-alive Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Content-Length: 0 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Host: 10.222.0.15 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-System-Scope: None Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: User-Agent: python-novaclient Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Auth-Token: gAAAAABjGpn6X4ZWEjh7ufINId41rOdUZkcA_cu3_uDsmO-QBbmgskZqiPFWZc7RM5PBGfkk9O9b1m0_PW-nGtkqUfWvy0nZvndxWXVskn4KoGQtELryJRZaNRErhcD_9DRb_qyZkuUqj24zNfR4mN1bOGIC11VSfuaVyCCcPhpCGERUSgeXlbo Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Id: None Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Name: None Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Identity-Status: Confirmed Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Is-Admin-Project: True Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Id: default Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Name: Default Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Name: admin Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Role: reader,admin,member Sep 09 01:42:19.672648 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Roles: reader,admin,member Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant: admin Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Name: admin Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User: admin Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Id: default Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Name: Default Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Name: admin Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: method: > Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: exception: Flavor 84 could not be found. Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: action_args: {'id': '84'} Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:19.674167 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:19.675102 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:19.676515 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-c6fd2798-2fcd-4bb2-a6c8-9f592541da9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:19.677782 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-c6fd2798-2fcd-4bb2-a6c8-9f592541da9f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011155 Sep 09 01:42:19.677782 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Sep 9 01:42:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 01:42:20.895306 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ac680cfc-6455-402b-acb2-74cbe76076b4 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:20.896350 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ac680cfc-6455-402b-acb2-74cbe76076b4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 09 01:42:20.896750 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:21.416245 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-4d37b09a-cff5-4a55-a7d7-36194069478a admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:21.422086 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.wsgi [None req-4d37b09a-cff5-4a55-a7d7-36194069478a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-4d37b09a-cff5-4a55-a7d7-36194069478a admin admin] Request method failure captured: Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept: application/json Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Accept-Encoding: gzip, deflate Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Connection: keep-alive Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Content-Length: 0 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Host: 10.222.0.15 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Openstack-System-Scope: None Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: User-Agent: python-novaclient Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Auth-Token: gAAAAABjGpn8jMJwBgkwV1rHi3B19hcVfcJbWO8qT8cjHRRwlFPvOVfOY-1Yd7sWMffgiHxmvMg-OeRyioHEyF1p4AfczeJkevG_nBhXods13WWOmfriqLNSUTzE6x82pFtfPOQ8tdyBfAGwMOVx2DcdVvmdXOlWLMUdAXniuFGSxQ9sm1CvQbE Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Id: None Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Domain-Name: None Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Identity-Status: Confirmed Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Is-Admin-Project: True Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Id: default Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Domain-Name: Default Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Project-Name: admin Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Role: reader,admin,member Sep 09 01:42:21.423573 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Roles: reader,admin,member Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant: admin Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-Tenant-Name: admin Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User: admin Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Id: default Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Domain-Name: Default Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: X-User-Name: admin Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: method: > Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: exception: Flavor 451 could not be found. Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: action_args: {'id': '451'} Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:21.425229 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:21.426057 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.427254 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-4d37b09a-cff5-4a55-a7d7-36194069478a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:21.429037 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-4d37b09a-cff5-4a55-a7d7-36194069478a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387443 Sep 09 01:42:21.429037 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:42:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 01:42:21.435464 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-ffa44c77-7dd9-41ce-b24c-34242b63ffe1 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:21.451186 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-ffa44c77-7dd9-41ce-b24c-34242b63ffe1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019285 Sep 09 01:42:21.451714 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:42:21.461207 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:21.476028 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018406 Sep 09 01:42:21.476576 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Sep 9 01:42:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:42:21.485791 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-fa4226a2-215e-4f84-8531-8f0b98f44f80 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:21.490831 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.wsgi [None req-fa4226a2-215e-4f84-8531-8f0b98f44f80 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-fa4226a2-215e-4f84-8531-8f0b98f44f80 admin admin] Request method failure captured: Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept: application/json Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Accept-Encoding: gzip, deflate Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Connection: keep-alive Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Content-Length: 0 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Host: 10.222.0.15 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-Api-Version: compute 2.92 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Openstack-System-Scope: None Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: User-Agent: python-novaclient Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Auth-Token: gAAAAABjGpn8jMJwBgkwV1rHi3B19hcVfcJbWO8qT8cjHRRwlFPvOVfOY-1Yd7sWMffgiHxmvMg-OeRyioHEyF1p4AfczeJkevG_nBhXods13WWOmfriqLNSUTzE6x82pFtfPOQ8tdyBfAGwMOVx2DcdVvmdXOlWLMUdAXniuFGSxQ9sm1CvQbE Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Id: None Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Domain-Name: None Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Identity-Status: Confirmed Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Is-Admin-Project: True Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Id: default Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Domain-Name: Default Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Project-Name: admin Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Role: reader,admin,member Sep 09 01:42:21.492819 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Roles: reader,admin,member Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/af9d764870ec46c58ab37a817dc46423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_af9d764870ec46c58ab37a817dc46423", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant: admin Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Id: af9d764870ec46c58ab37a817dc46423 Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-Tenant-Name: admin Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User: admin Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Id: default Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Domain-Name: Default Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Id: 2a2e93b317db4de6850826f625ccc3db Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: X-User-Name: admin Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: method: > Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: exception: Flavor 451 could not be found. Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: action_args: {'id': '451'} Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:42:21.494356 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:21.495207 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: ERROR nova.api.openstack.wsgi Sep 09 01:42:21.496274 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-fa4226a2-215e-4f84-8531-8f0b98f44f80 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:42:21.497522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-fa4226a2-215e-4f84-8531-8f0b98f44f80 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011972 Sep 09 01:42:21.497522 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:42:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 01:42:22.715772 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:22.716788 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 09 01:42:22.717209 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:23.233133 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-002f6c13-3017-4c1e-bd2c-6ea190e2cf36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:42:23.253213 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-002f6c13-3017-4c1e-bd2c-6ea190e2cf36 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.399267 Sep 09 01:42:23.253759 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 01:42:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:42:24.464253 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:24.465290 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 09 01:42:24.465677 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:24.984170 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-0872e42a-21cf-4f28-a348-8db0ae53cd76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:42:25.003335 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-0872e42a-21cf-4f28-a348-8db0ae53cd76 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397397 Sep 09 01:42:25.003883 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 01:42:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:42:26.224550 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:26.225696 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Sep 09 01:42:26.226092 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:26.751570 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-0378b5f5-1e31-4599-8960-57d3cf03adcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:42:26.770475 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-0378b5f5-1e31-4599-8960-57d3cf03adcd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403668 Sep 09 01:42:26.771008 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 01:42:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:42:27.986635 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:27.987642 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 09 01:42:27.988029 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:28.504312 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-0a8c2413-e70d-497b-b6e0-f413af16c885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:42:28.524545 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-0a8c2413-e70d-497b-b6e0-f413af16c885 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398149 Sep 09 01:42:28.525313 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Sep 9 01:42:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:42:29.737970 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:29.738947 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 09 01:42:29.739345 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:42:30.256766 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-e446f7c6-7814-48ee-82c5-f660cc59fc7a admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:42:30.277832 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-e446f7c6-7814-48ee-82c5-f660cc59fc7a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399595 Sep 09 01:42:30.278375 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Fri Sep 9 01:42:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:43:27.595074 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:27.596089 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-adf35bc3-f510-404a-978e-6dcdc06ef853 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 09 01:43:27.596485 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Fri Sep 9 01:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:43:27.607886 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:43:27.980195 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-24d5cdc7-f22a-4741-952c-5ea7262963fd admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:28.000699 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-24d5cdc7-f22a-4741-952c-5ea7262963fd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397584 Sep 09 01:43:28.001279 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Sep 9 01:43:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:43:28.022365 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_api:SELECT=14 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:43:28.026157 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-cf2e9a07-d8af-45b7-b686-75e68fb6d556 admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:28.033407 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-cf2e9a07-d8af-45b7-b686-75e68fb6d556 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012462 Sep 09 01:43:28.033928 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Sep 9 01:43:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:43:28.045833 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-3f22f531-d287-4502-baff-5f0721d62e0b admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:28.053594 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-3f22f531-d287-4502-baff-5f0721d62e0b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011315 Sep 09 01:43:28.054105 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Sep 9 01:43:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:43:28.065054 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:28.072036 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010415 Sep 09 01:43:28.072548 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Sep 9 01:43:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:43:28.083339 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-7140ef6e-1fa7-4ffd-8b18-bcca68767df6 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:43:28.090239 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-7140ef6e-1fa7-4ffd-8b18-bcca68767df6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010345 Sep 09 01:43:28.090743 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Sep 9 01:43:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:46:25.745406 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:25.746417 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Sep 09 01:46:25.746845 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:46:25.893919 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_api:SELECT=6 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:46:26.055695 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:26.061082 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:26.061558 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:26.061991 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:26.062709 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:26.063156 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:26.063575 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:26.094747 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-e3034aaa-514c-44ab-ad28-4a1cc1dfb193 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.202062 Sep 09 01:46:26.095241 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:46:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:46:27.163131 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:27.164168 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 09 01:46:27.164565 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:46:27.368146 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:27.371550 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:27.372014 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:27.372463 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:27.373216 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:27.373652 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:27.374061 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:27.393678 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-88a281a9-af21-4263-8c48-afb091ced3f4 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076820 Sep 09 01:46:27.394208 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:46:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:46:38.885584 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:38.886591 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Sep 09 01:46:38.886984 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:46:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:46:39.030794 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_cell0:SELECT=4 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:46:39.031518 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_cell1:SELECT=4 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:46:39.032193 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG dbcounter [-] [111896] Writing DB stats nova_api:SELECT=8 {{(pid=111896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:46:39.079452 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:39.082843 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:39.083312 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:39.083737 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:39.084443 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:39.084885 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:39.085329 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:39.111086 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-58d09357-1ce7-483b-823d-4a4b29d5514e admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084661 Sep 09 01:46:39.111568 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:46:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:46:40.185937 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG nova.api.openstack.wsgi [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] Calling method '>' {{(pid=111895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:40.186941 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: INFO nova.api.openstack.requestlog [None req-556c2d30-5999-420b-9080-a32b8b74e7df admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 09 01:46:40.187338 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: [pid: 111895|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Sep 9 01:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:46:40.376036 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG nova.api.openstack.wsgi [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Calling method '>' {{(pid=111896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:46:40.379412 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:40.379883 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:40.380305 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:40.381009 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:46:40.381477 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:46:40.381918 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: DEBUG oslo_concurrency.lockutils [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:46:40.404052 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: INFO nova.api.openstack.requestlog [None req-8763ab8d-4f7b-4b64-8c86-71758111a3bd admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078179 Sep 09 01:46:40.404532 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: [pid: 111896|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Sep 9 01:46:40 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:47:37.968938 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: Fri Sep 9 01:47:37 2022 - graceful shutdown triggered... Sep 09 01:47:37.969470 dv-cinder-852210-12-iscsi devstack@n-api.service[111896]: Gracefully killing worker 2 (pid: 111896)... Sep 09 01:47:37.968980 dv-cinder-852210-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 01:47:37.970277 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: Gracefully killing worker 1 (pid: 111895)... Sep 09 01:47:38.094494 dv-cinder-852210-12-iscsi devstack@n-api.service[111895]: DEBUG dbcounter [-] [111895] Writing DB stats nova_api:SELECT=4 {{(pid=111895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:47:38.970009 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: worker 1 buried after 1 seconds Sep 09 01:47:38.970522 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: worker 2 buried after 1 seconds Sep 09 01:47:38.970522 dv-cinder-852210-12-iscsi devstack@n-api.service[111894]: goodbye to uWSGI. Sep 09 01:47:38.971550 dv-cinder-852210-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 01:47:38.972107 dv-cinder-852210-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 01:47:38.974899 dv-cinder-852210-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 01:47:38.987786 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 01:47:38 2022] *** Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: nodename: dv-cinder-852210-12-iscsi Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: machine: x86_64 Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: clock source: unix Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: pcre jit disabled Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: detected number of CPU cores: 4 Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: current working directory: / Sep 09 01:47:38.989990 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: detected binary path: /usr/bin/uwsgi-core Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: your processes number limit is 47680 Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: your memory page size is 4096 bytes Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: detected max file descriptor number: 2048 Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: lock engine: pthread robust mutexes Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: thunder lock: enabled Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 01:47:38.990724 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 01:47:39.031951 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: Python main interpreter initialized at 0x55f375f989c0 Sep 09 01:47:39.031951 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: python threads support enabled Sep 09 01:47:39.031951 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: your server socket listen backlog is limited to 100 connections Sep 09 01:47:39.031951 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: your mercy for graceful operations on workers is 90 seconds Sep 09 01:47:39.032388 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 01:47:39.032388 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: *** Operational MODE: preforking *** Sep 09 01:47:39.032658 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: *** uWSGI is running in multiple interpreter mode *** Sep 09 01:47:39.032658 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: spawned uWSGI master process (pid: 126877) Sep 09 01:47:39.032866 dv-cinder-852210-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 01:47:39.037411 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: spawned uWSGI worker 1 (pid: 126895, cores: 1) Sep 09 01:47:39.037411 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: spawned uWSGI worker 2 (pid: 126896, cores: 1) Sep 09 01:47:39.037411 dv-cinder-852210-12-iscsi devstack@n-api.service[126877]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 01:47:39.703155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 01:47:39.728152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 01:47:40.855604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:47:40.855604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: from cryptography.utils import int_from_bytes Sep 09 01:47:40.856224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:47:40.856224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: from cryptography.utils import int_from_bytes Sep 09 01:47:40.892569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:47:40.892569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: from cryptography.utils import int_from_bytes Sep 09 01:47:40.893336 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 01:47:40.893336 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: from cryptography.utils import int_from_bytes Sep 09 01:47:43.331627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 01:47:43.332314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 01:47:43.332452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 01:47:43.332823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 01:47:43.333119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 01:47:43.333509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.333842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.334167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.334493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.334832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.335148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.335540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.335871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.336207 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.336473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.336795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.337332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-12-iscsi {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.337667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.337990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.338309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.338636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.338950 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.339281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.339595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.340111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.340563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.340886 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.341223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.341576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.341899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.342212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.342537 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.342852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.343195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.343617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.344067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-12-iscsi {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.344404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.344728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.345090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.345611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.346069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.346487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.346900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.347251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.347573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.348115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.348518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.348856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.349215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.349531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.350003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.350400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.350729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.351650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.351965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.352227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.352543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.352876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.353235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.353568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.353832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.354090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.354424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.354749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.355064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.355378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.355689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.356002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.356313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.356624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.356935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.357274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.357598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.357919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.358246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.358561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.358884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.359302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.359588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.359871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.360220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.360546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.360863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.361214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.361545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.361857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.362170 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.362482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.362806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.363150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.363459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.363713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.364024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.364340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.364662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.364975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.365311 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.365802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.366121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.366436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.367322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.367635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.367948 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.368258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.368570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.368878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.369212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.369523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.369832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.370161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.370489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.370802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.371113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.371427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.371738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.372069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.372384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.372695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.373024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.373362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.373927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.374258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.374568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.374879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.375205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.375524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.375813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.376140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.376448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.376756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.377094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.377394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.377702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.378013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.378324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.378630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.378936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.379261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.379588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.379902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.380213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.380521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.380846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.381211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.381552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.381901 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.382263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.382608 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.382945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.383271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.383588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.383906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.384245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.384564 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.384878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.384984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 01:47:43.385441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.385525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 01:47:43.385596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.385785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 01:47:43.385893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.386148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 01:47:43.386252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.386401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 01:47:43.386500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.386775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.386874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.387100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.387192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.387417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.387517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.387737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.387835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.388067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.388165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.388380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.388498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.388698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.388801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.389014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.389142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.389367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.389478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.389629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.389735 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.389946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.390049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.390351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.390442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-12-iscsi {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.390668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.390759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.390982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.391081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.391299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.391403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.391616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.391715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.391925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.392016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.392253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.392387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.392565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.392727 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.392878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.393099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.393237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.393419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.393545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.393727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.393834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.394043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.394140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.394381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.394477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.394698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.394803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.395006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.395113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.395323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.395427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.395632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.395803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.395954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.396131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.396296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.396451 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.396649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-12-iscsi {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.396770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.396964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.397105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.397306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.397423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.397620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.397736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.398059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.398168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.398371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.398526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.398667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.398796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.399000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.399112 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.399286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.399379 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.399608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.399707 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.399936 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.400029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.400248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.400346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.400567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.400658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.400885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.401029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.401210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.401312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.401520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.401619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.401829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.401919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.402137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.402241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.402445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.402553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.402751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.402910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.403013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.403099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.403295 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.403394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.403619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.403744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.403946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.404060 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.404267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.404385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.404522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.404632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.404771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.404873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.405110 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.405219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.405437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.405551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.405744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.405845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.406051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.406142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.406357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.406457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.406663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.406754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.406969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.407068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.407273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.407374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.407578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.407669 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.407884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.407974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.408200 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.408292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.408512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.408604 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.408834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.408933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.409165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.409269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.409485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.409586 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.409812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.409903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.410119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.410220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.410427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.410527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.410738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.410838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.411056 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.411177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.411365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.411465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.411673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.411781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.411981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.412090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.412285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.412384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.412590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.412685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.412897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.413050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.413239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.413333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.414069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.414175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.414384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.414473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.414702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.414793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.415013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.415119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.415317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.415417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.415637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.415750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.415944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.416043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.416251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.416343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.416556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.416663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.416856 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.416955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.417184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.417294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.417490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.417589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.417798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.417889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.418105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.418206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.418410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.418510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.418716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.418893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.419019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.419120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.419325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.419428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.419625 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.419727 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.419927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.420027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.420247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.420340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.420569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.420673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.420877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.420970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.421206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.421308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.421513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.421607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.421819 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.421911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.422142 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.422242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.422452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.422543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.422755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.422861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.423075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.423168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.423382 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.423481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.423687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.423793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.424011 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.424126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.424317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.424409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.424621 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.424741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.424939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.425041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.425284 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.425427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.425599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.425756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.425930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.426062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.426245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.426360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.426565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.426682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.426874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.426968 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.427191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.427290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.427491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.427590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.427793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.427885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.428097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.428196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.428399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.428491 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.428699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.428798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.429016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.430111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.430383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.430484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.430484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.430647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.430731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.430820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.430911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.431114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.431267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.431530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.431618 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 01:47:43.431846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.432115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.432206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.432458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.432674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.432768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.433148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.433298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.433397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.433697 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.433785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434011 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434349 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.434979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.435248 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.435371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.435605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.435751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.435912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.436235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.436421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.436738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.436837 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.437050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.437269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.437384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.437694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.437793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.438964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.439288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.439457 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.439602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.439923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.440022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.440241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.440558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.440650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.440885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.441177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.441273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.441534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.441753 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.441843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.442152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.442338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.442469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.442829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.442925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.443112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.443606 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.443726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.443820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.443904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444672 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.444797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.445991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.446997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.447098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.447392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.447630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.447729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.447957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.448144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.448275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.448584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.448672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.448897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.449084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.449235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.449545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.449662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.449993 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.450115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.450314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.450623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.450726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.450939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.451969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.452897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.453868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.454837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455396 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455609 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455697 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.455932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.456993 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.457287 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.457387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.457603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.457702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.457913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.458939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459151 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459457 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.459858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.460828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461366 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461760 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.461982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462391 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.462907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.463944 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464245 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.464895 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465511 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.465822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.466946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467583 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467774 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.467947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.468829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.469999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.470922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.471947 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472774 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.472879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473740 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.473882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.474968 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475066 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.475908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.476502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.476740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.476825 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.477791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.478982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.479922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.480945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.481902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.482827 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483456 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.483986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484407 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.484923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.485980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.486902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487117 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.487830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488350 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488753 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.488962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489381 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489762 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.489905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.490973 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.491181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.491272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.491484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.491677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.492338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.492431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.492664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.492761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.492974 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.493948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494557 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.494869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.495834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496344 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.496983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.497932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.498155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.498253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.498466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.498566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.499841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.500976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.501992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502643 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502864 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.502963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.503213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.503310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.503529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.503630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.503928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.504923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505749 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.505928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.506886 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507846 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.507945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508238 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.508857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.509799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.510934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.511979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.512950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513184 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.513898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.514792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.515939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516557 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.516867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.517999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.518928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.519942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.520856 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.521814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.522736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.523486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.523588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.523809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.523900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524138 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.524832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525685 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.525782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.526937 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527850 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.527949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.528160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.528260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.528462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.528553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.528763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529125 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529767 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.529989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.530994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531618 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.531934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532245 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.532906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.533868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.534809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.535955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536056 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.536989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537870 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.537967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.538171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.538260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.538524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539339 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.539958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540699 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.540892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541095 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.541846 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542065 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.542822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543130 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.543991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.544917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.545871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.546917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547790 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.547998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.548089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.548356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.548503 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.548680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.548818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.549775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550106 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.550956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.551960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.552907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553767 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.553921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554147 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.554876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555214 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.555815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.556957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.557929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.558986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.559942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560258 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.560894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561147 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561470 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561563 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.561881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562537 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.562969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.563953 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564656 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.564987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.565219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.565360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.565569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.565667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.565916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.566023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.566245 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.566335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.566569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.566660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567481 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.567874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.568824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.569037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.569183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.569379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.569468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.569738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.570073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.570421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.570579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.570717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.571267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.571378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.571627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.571952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.572307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.572562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.572659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.572891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.573914 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574853 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.574952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.575883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.576839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.577987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578295 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.578935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.579179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.579422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.579738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580470 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.580818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.581839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.583637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.583777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.583893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584110 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584496 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584496 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.584913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.585051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.585814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.585935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586609 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.586939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.587954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588062 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.588989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.589970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.590934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.591924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.592997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.593937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.594882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595696 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.595835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.596950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.597108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.597312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.597456 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.597743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.597889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598536 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.598866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599377 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.599825 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.600997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.601678 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.601818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.601954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602134 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.602969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603364 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.603937 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.604077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.604364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.604725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.605048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.607528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.617116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.618399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.619525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.620822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.621392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.621945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.622486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.623036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.623575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.624471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.625010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.625579 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.626151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.626702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.627239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.627916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.628449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.628980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.629574 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.630135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.630549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.631044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.631371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.631827 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.632234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.632893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.633347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.633836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.634153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.634578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.634969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.635353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.635736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.636136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.636523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.636911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.637665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.637665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.638190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.638506 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.638891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.639309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.639732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.640152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.640489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.640873 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.641271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.641796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.641977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.642280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.642607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.642929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.643253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.643604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.643902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.644222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.644939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.644939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.645284 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.645723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.645932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.646250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.646686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.647004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.647327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.647651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.648535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.648817 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.649419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.649687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.650014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.650330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.650674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.650988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.651313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.651636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.651999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.652301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.652605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.652909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.653264 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.653582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.653888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.654197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.654512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.654820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.655128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.655432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.655742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.656052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.656357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.656663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.656972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.657306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.657659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.657913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.658223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.658528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.659409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.659409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.659409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.659714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.660203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.660693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.661196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.661699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.662174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.662673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.662993 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.663320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.664206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.664532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.664845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.668678 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.673223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO dbcounter [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Registered counter for database nova_api Sep 09 01:47:43.673474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.673849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.674210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.674728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.675234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.675731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.676240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.676741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.677243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.677742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.678230 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.678734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.679285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.679616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.679944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.680334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.681021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.681169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.681463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.681824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.682369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.682962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.683369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.683660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.684016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.684532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.684859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.689149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.689149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 01:47:43.689149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 01:47:43.693663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_db.sqlalchemy.engines [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.701420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writer thread running {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.759113 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO dbcounter [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Registered counter for database nova_api Sep 09 01:47:43.760769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.context [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43400d51-3c7d-455c-8c25-cdb5e9eccfe4(cell1) {{(pid=126895) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 01:47:43.765076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:47:43.765784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:47:43.767542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:47:43.768488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:47:43.769175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:47:43.771382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:47:43.774197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO dbcounter [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Registered counter for database nova_cell0 Sep 09 01:47:43.781919 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_db.sqlalchemy.engines [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.782626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO dbcounter [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Registered counter for database nova_cell1 Sep 09 01:47:43.790373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writer thread running {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.790562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_db.sqlalchemy.engines [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.799604 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_db.sqlalchemy.engines [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.804725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writer thread running {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.805378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writer thread running {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.856570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.context [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),43400d51-3c7d-455c-8c25-cdb5e9eccfe4(cell1) {{(pid=126896) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 01:47:43.869809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:47:43.870722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:47:43.872580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:47:43.873942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:47:43.875906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:47:43.878716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:47:43.880988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO dbcounter [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Registered counter for database nova_cell0 Sep 09 01:47:43.887424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO dbcounter [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Registered counter for database nova_cell1 Sep 09 01:47:43.902821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_db.sqlalchemy.engines [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.903652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_db.sqlalchemy.engines [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.921863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writer thread running {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.923913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writer thread running {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:43.971113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO dbcounter [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Registered counter for database nova_cell0 Sep 09 01:47:43.979136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_db.sqlalchemy.engines [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:43.984941 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writer thread running {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:44.088989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO dbcounter [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Registered counter for database nova_cell0 Sep 09 01:47:44.097553 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_db.sqlalchemy.engines [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 01:47:44.103109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writer thread running {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 01:47:44.309110 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: WARNING keystonemiddleware.auth_token [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:47:44.316495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: WARNING keystonemiddleware.auth_token [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:47:44.423226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: WARNING keystonemiddleware.auth_token [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:47:44.431155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: WARNING keystonemiddleware.auth_token [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:47:44.660259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: WARNING keystonemiddleware.auth_token [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:47:44.667092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: WARNING keystonemiddleware.auth_token [None req-e53acf53-b26c-4854-9644-d5a1af846d14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:47:44.672478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f375f989c0 pid: 126895 (default app) Sep 09 01:47:44.772021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: WARNING keystonemiddleware.auth_token [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 01:47:44.778388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: WARNING keystonemiddleware.auth_token [None req-e502a393-0006-42e2-ae80-2d6c583ca62f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 01:47:44.783630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f375f989c0 pid: 126896 (default app) Sep 09 01:48:21.789749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.790629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.791550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.792352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.915580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.916582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.917374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:21.918146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:23.202655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b47cd1b9-323f-4f58-b6a2-f8b3f99c13eb tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Action: 'create', calling method: .version_select at 0x7f87d95983a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-651792836", "metadata": {"Type": "work"}}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:23.296623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0e163dcb-979c-473c-b59a-ee1f0638ea9b tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Action: 'create', calling method: .version_select at 0x7f87d959b3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1387290522"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:25.211248 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0e163dcb-979c-473c-b59a-ee1f0638ea9b tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.302460 Sep 09 01:48:25.221800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Sep 9 01:48:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3314 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 01:48:25.228467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-bfa06eb4-7a20-463b-825f-b957b8541582 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947d280>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:25.296841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b47cd1b9-323f-4f58-b6a2-f8b3f99c13eb tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.520986 Sep 09 01:48:25.298613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 01:48:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3525 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 01:48:25.316022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9f3767e7-98c1-4ead-80c2-d68d956cb84e tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d947c280>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:25.520551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-bfa06eb4-7a20-463b-825f-b957b8541582 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 200 len: 345 microversion: 2.1 time: 0.297276 Sep 09 01:48:25.522010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:25 2022] GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 345 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:25.565695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9f3767e7-98c1-4ead-80c2-d68d956cb84e tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.255509 Sep 09 01:48:25.566982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:25 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:26.537805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-524fa11f-04b0-4508-abf0-29bc331cde50 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947d940>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:26.580918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6d154429-ce88-432d-a99f-c9649cd7afe8 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d947c940>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:26.657556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-524fa11f-04b0-4508-abf0-29bc331cde50 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 200 len: 346 microversion: 2.1 time: 0.125257 Sep 09 01:48:26.658114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:26 2022] GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:26.671841 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f0c2b6e3-2439-4477-a001-14c0398b6a6f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Action: 'create', calling method: .version_select at 0x7f87d947df70>, body: {"snapshot": {"volume_id": "77640520-6aa5-405d-a17d-1188dc743189", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1860767916"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:26.791939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6d154429-ce88-432d-a99f-c9649cd7afe8 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 353 microversion: 2.1 time: 0.216039 Sep 09 01:48:26.792770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:26 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:26.805666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b3701bae-0958-46ab-b8ef-64f6d1ce3853 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d9405040>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.011821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b3701bae-0958-46ab-b8ef-64f6d1ce3853 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 353 microversion: 2.1 time: 0.208207 Sep 09 01:48:27.014083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:26 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:27.028645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f0c2b6e3-2439-4477-a001-14c0398b6a6f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.360724 Sep 09 01:48:27.029262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 4/8] 10.222.0.15 () {60 vars in 1162 bytes} [Fri Sep 9 01:48:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:27.038380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-78aba94a-72ee-4e10-a871-0b50d665e94c tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d94051f0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.040371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2559ef9d-5609-4c62-8867-97253fc0ee18 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947dca0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.126399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2559ef9d-5609-4c62-8867-97253fc0ee18 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.089808 Sep 09 01:48:27.126959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:27 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:27.139804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff4ca0a5-49dd-4256-8adb-6890d264c6d8 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947d790>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.245569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-78aba94a-72ee-4e10-a871-0b50d665e94c tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 202 len: 0 microversion: 2.1 time: 0.215902 Sep 09 01:48:27.246995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:48:27 2022] DELETE /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 01:48:27.247784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff4ca0a5-49dd-4256-8adb-6890d264c6d8 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113332 Sep 09 01:48:27.248721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Sep 9 01:48:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:27.260500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5056f4e5-3034-4242-89b9-ca4ab8d296c5 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d94059d0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.261673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-973bc0e1-1c7a-48e5-83b3-08c2dd9db363 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d94071f0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:27.341548 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-973bc0e1-1c7a-48e5-83b3-08c2dd9db363 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.084812 Sep 09 01:48:27.342655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:27 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:27.362900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5056f4e5-3034-4242-89b9-ca4ab8d296c5 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.104550 Sep 09 01:48:27.363477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:27 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:28.355107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ab533a71-af0c-4596-b746-320d3c018d54 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d9407a60>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:28.378362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2e2d3877-7d14-44d4-a9e2-c472cd480dcd tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d940a0d0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:28.416369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ab533a71-af0c-4596-b746-320d3c018d54 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.065273 Sep 09 01:48:28.421322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:28 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:28.481276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2e2d3877-7d14-44d4-a9e2-c472cd480dcd tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.105931 Sep 09 01:48:28.482515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:28 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:29.429555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c2063b47-4d62-40cf-83d0-455044adeb60 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d9407ee0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:29.499317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a515ac4d-909d-4a4d-b94b-736a9ea2173a tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d940a670>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:29.518070 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c2063b47-4d62-40cf-83d0-455044adeb60 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.092911 Sep 09 01:48:29.523699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:29 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:29.597448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a515ac4d-909d-4a4d-b94b-736a9ea2173a tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.101922 Sep 09 01:48:29.598360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:29 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:30.535958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-117935b8-8e18-4dee-98ac-1e3cedc1a237 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947d0d0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:30.611317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-117935b8-8e18-4dee-98ac-1e3cedc1a237 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.083602 Sep 09 01:48:30.611647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6b54cd3f-8ce2-4797-8ab5-7143357f3cd7 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d940a940>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:30.612089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:30 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:30.706135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6b54cd3f-8ce2-4797-8ab5-7143357f3cd7 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.098212 Sep 09 01:48:30.706824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:30 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:31.625753 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-94e3d016-6920-4c8f-99f9-4d672171342e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d947d790>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:31.675671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-94e3d016-6920-4c8f-99f9-4d672171342e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.055407 Sep 09 01:48:31.681556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 11/20] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:31 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:31.721213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b74c3a76-4dc0-4c9b-bcb6-ac89c7c6abf4 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d947d040>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:31.871711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b74c3a76-4dc0-4c9b-bcb6-ac89c7c6abf4 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.154250 Sep 09 01:48:31.875827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 10/21] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:31 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:32.689682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-214813a8-1a4a-4613-bf05-84e9a3462087 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d9407160>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:32.755844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-214813a8-1a4a-4613-bf05-84e9a3462087 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.070476 Sep 09 01:48:32.763364 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:32 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:32.886215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7714c78d-785d-43c5-b2d2-063a458f1e08 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d947d700>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:33.013744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7714c78d-785d-43c5-b2d2-063a458f1e08 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.131312 Sep 09 01:48:33.014398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:32 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:33.206844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1011284220", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "networks": [{"uuid": "6576891c-7865-4e85-9fd4-29415bb7b9c7"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:33.545376 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] validate_networks() for [('6576891c-7865-4e85-9fd4-29415bb7b9c7', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:48:33.776787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8fdd047d-5204-4e95-a76d-9fdadbe82457 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d940adc0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:33.902187 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8fdd047d-5204-4e95-a76d-9fdadbe82457 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.136825 Sep 09 01:48:33.907937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 12/24] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:33 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:34.028867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-93dc0c95-df99-4ae5-a114-886f588aa5fc tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d940a790>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:34.149721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-93dc0c95-df99-4ae5-a114-886f588aa5fc tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.124993 Sep 09 01:48:34.150966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:34 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:35.279829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1001673762", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:35.509210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] validate_networks() for [('7a438537-4f4f-4149-a51c-6d26a9806efa', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:48:35.944572 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:48:35.945091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:48:35.946351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:48:35.947010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:48:35.947649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:48:35.991176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:35.992000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:35.992679 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:35.993655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:35.994392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:35.995037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:36.095286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Getting quotas for project 940a7e4459874ae3b54c5db3ec096b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:48:36.104278 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Getting quotas for user 6d415854b71b4366a2f8d11e64271ccc and project 940a7e4459874ae3b54c5db3ec096b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:48:36.123558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:48:36.127456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:48:36.306537 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8ae44554-a773-4773-a639-050ce001d517 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.319343 Sep 09 01:48:36.315598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 13/26] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 01:48:36.330788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a8c5234e-a8a7-402c-a757-794283d70476 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8b1d550>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:36.418754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a8c5234e-a8a7-402c-a757-794283d70476 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.101740 Sep 09 01:48:36.419762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:36 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:36.424759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-68f6f920-9b31-421c-97ac-09a51b95a493 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d947de50>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:36.613349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-68f6f920-9b31-421c-97ac-09a51b95a493 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.184998 Sep 09 01:48:36.613349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:36 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:36.617744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b5192cd6-5e2f-405f-aedb-4740dc17f3ee tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:36.618369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b5192cd6-5e2f-405f-aedb-4740dc17f3ee tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:36.799581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b5192cd6-5e2f-405f-aedb-4740dc17f3ee tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:36.847726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b5192cd6-5e2f-405f-aedb-4740dc17f3ee tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1215 microversion: 2.1 time: 0.240104 Sep 09 01:48:36.849006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:36 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:36.955593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:48:36.956146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:48:36.956529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:48:36.956936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:48:36.957379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:48:37.011172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:37.012564 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:37.015629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:37.017419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:37.021748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:37.022589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:37.100625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:48:37.112155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for user 3153c9ff011f4ab8958fc49795e6f8f1 and project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:48:37.151631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:48:37.154477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:48:37.319087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f1337f86-7159-4949-83fe-02f222e22ae1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.477992 Sep 09 01:48:37.321767 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 14/30] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:48:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 01:48:37.335633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fed0e474-8f11-4045-a97b-683e93778128 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:37.337659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fed0e474-8f11-4045-a97b-683e93778128 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:37.410573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fed0e474-8f11-4045-a97b-683e93778128 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:37.434545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fed0e474-8f11-4045-a97b-683e93778128 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1222 microversion: 2.1 time: 0.104074 Sep 09 01:48:37.454814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 15/31] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:37 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:37.475212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-793848db-9fe1-44c5-98ad-18d1d4ed9c5f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d9421550>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:37.491654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4d712aad-6208-4f78-a792-1d4af132aea7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: .version_select at 0x7f87d8b1dd30>, body: {"keypair": {"name": "tempest-keypair-355746002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI98RLIAKc1OLnIEhnkq8pTx6/biM8jdnpd6Ca+d1d68MOix2bEz2u6T+nVYYbJV8pAvmPLvzUshH6e284lLH7T2KktfdMpzwUuquDJjJ2R6RY3kEy5T5Besi3NaLBsvxg=="}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:37.537051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-793848db-9fe1-44c5-98ad-18d1d4ed9c5f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.082129 Sep 09 01:48:37.539195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:37 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:37.578347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-4d712aad-6208-4f78-a792-1d4af132aea7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:48:37.592371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-4d712aad-6208-4f78-a792-1d4af132aea7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for user 83f9dc8c41604f0e86eaf57202285cc4 and project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:48:37.627832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-94b0a8cd-16e9-4523-a77b-ef87397d8af4 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8abe790>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:37.750775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4d712aad-6208-4f78-a792-1d4af132aea7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.897668 Sep 09 01:48:37.755127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 17/33] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:48:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:37.790709 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1845101830", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:37.816351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-94b0a8cd-16e9-4523-a77b-ef87397d8af4 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.199126 Sep 09 01:48:37.817143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 17/34] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:37 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:37.875185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d6f75ce6-0607-469a-99d3-4a798058a9c9 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:37.876507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d6f75ce6-0607-469a-99d3-4a798058a9c9 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:37.972290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] validate_networks() for [('7a438537-4f4f-4149-a51c-6d26a9806efa', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:48:38.272777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d6f75ce6-0607-469a-99d3-4a798058a9c9 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:38.283421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d6f75ce6-0607-469a-99d3-4a798058a9c9 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1215 microversion: 2.1 time: 0.412205 Sep 09 01:48:38.284015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 18/35] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:37 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1215 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:38.557543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a2960e30-fbfb-4927-af31-d4b1664c8dbb tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d9421550>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:38.630755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a2960e30-fbfb-4927-af31-d4b1664c8dbb tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 288 microversion: 2.1 time: 0.081981 Sep 09 01:48:38.631630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 19/36] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:38 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:38.650074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-37024540-dc6b-48ed-ab12-18cbad4d22ca tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8b1c280>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:38.805769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-37024540-dc6b-48ed-ab12-18cbad4d22ca tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 202 len: 0 microversion: 2.1 time: 0.160489 Sep 09 01:48:38.809484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 20/37] 10.222.0.15 () {58 vars in 1254 bytes} [Fri Sep 9 01:48:38 2022] DELETE /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:48:38.814469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ff0233d1-1d67-4a2c-9002-df11932c65ed tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8acb5e0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:38.866717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ff0233d1-1d67-4a2c-9002-df11932c65ed tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.054472 Sep 09 01:48:38.868731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 21/38] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:38 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:48:38.874508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ffc57e12-4cbf-4c45-b1d1-93e784b5cae5 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8b1ca60>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:39.043572 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ffc57e12-4cbf-4c45-b1d1-93e784b5cae5 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.172597 Sep 09 01:48:39.044776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 22/39] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:38 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:39.314777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:39.316166 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:39.329269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:39.330021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:39.330761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:39.333126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:39.333836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:39.341597 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:39.460978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:48:39.461544 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:48:39.461882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:48:39.462287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:48:39.462694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:48:39.484477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:39.484968 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:39.485426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:39.493350 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:39.493854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:39.494294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:39.552520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:48:39.563206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:39.570279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for user 3153c9ff011f4ab8958fc49795e6f8f1 and project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:48:39.585979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-240b5b4f-d9bc-4efb-9cb1-6873907fd6b4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1211 microversion: 2.1 time: 0.277929 Sep 09 01:48:39.601544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 23/40] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:39 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1211 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:39.601778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:48:39.601778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:48:39.726498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-544d02e9-b297-4740-a5c6-42fb9d3ecc8a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.950449 Sep 09 01:48:39.727837 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 18/41] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:48:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:48:39.740197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7f13707a-d4d5-44e3-81ac-ec87e6f4a5ac tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:39.740874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7f13707a-d4d5-44e3-81ac-ec87e6f4a5ac tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:39.847680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7f13707a-d4d5-44e3-81ac-ec87e6f4a5ac tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:39.859558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7f13707a-d4d5-44e3-81ac-ec87e6f4a5ac tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1222 microversion: 2.1 time: 0.123234 Sep 09 01:48:39.862286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 24/42] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:39 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:39.885943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-87337165-cc6d-4c3a-ace9-0458ffb41c1c tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8ade040>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:39.971704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-87337165-cc6d-4c3a-ace9-0458ffb41c1c tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.093764 Sep 09 01:48:39.977818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 19/43] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:39 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:40.059703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-61077f70-152e-41c6-8469-03d76a7b1728 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8a3e4c0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:40.164096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-61077f70-152e-41c6-8469-03d76a7b1728 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.108361 Sep 09 01:48:40.165731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 25/44] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:40 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:40.614606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:40.615330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:40.626699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:40.627455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:40.628079 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:40.628969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:40.629677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:40.630633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:40.880073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:40.886910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:40.887530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:40.894302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-48f415ff-42ea-49d4-9a9e-08588e136aa3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1211 microversion: 2.1 time: 0.285218 Sep 09 01:48:40.896510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 20/45] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:40 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1211 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:40.912882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:40.913585 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:40.914189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:40.915046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:40.915659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:40.916230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:40.995754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-673d9660-9448-4852-b10a-95830ef1884a tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8a64e50>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:41.002738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:41.018199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b3b73792-afd8-4e33-b33b-3b4e03b7a46b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1226 microversion: 2.1 time: 0.134484 Sep 09 01:48:41.019150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 26/46] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:40 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:41.038139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-673d9660-9448-4852-b10a-95830ef1884a tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.054287 Sep 09 01:48:41.040975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 21/47] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:40 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:41.180234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-84a891fb-78d5-461e-b7d4-ccad14d1740c tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8abe4c0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:41.241531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-84a891fb-78d5-461e-b7d4-ccad14d1740c tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.065585 Sep 09 01:48:41.242107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 27/48] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:41 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:41.387840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-919826166", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "925a2cfe-0749-4777-b934-d3107264ee82"}], "security_groups": [{"name": "tempest-securitygroup--1849302293"}], "key_name": "tempest-keypair-355746002", "user_data": "}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:48:41.565541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] validate_networks() for [('925a2cfe-0749-4777-b934-d3107264ee82', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:48:41.918004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:41.919258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:41.935471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:41.936257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:41.936855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:41.937613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:41.938068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:41.938495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:42.180666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:42.189223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-98f7965f-2ed3-46bd-bbd7-b6d86861de51 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1211 microversion: 2.1 time: 0.274952 Sep 09 01:48:42.190046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 28/49] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:41 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:42.194788 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:42.199684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:42.205931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:42.206613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:42.207129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:42.208434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:42.208961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:42.209567 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:42.241801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:48:42.242384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:48:42.242807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:48:42.243223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:48:42.243636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:48:42.253431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:42.253926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:42.254366 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:42.255122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:42.255774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:42.256497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:42.275019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:48:42.279250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for user 83f9dc8c41604f0e86eaf57202285cc4 and project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:48:42.291655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:48:42.294709 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:48:42.297280 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:42.308357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b1cfb2f4-e3da-4304-a446-b634f66900de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1226 microversion: 2.1 time: 0.116952 Sep 09 01:48:42.321088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 29/50] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:42 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:42.321088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-52792bdd-c67c-45fe-8313-fd1226e74629 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8a4d790>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:42.355331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-52792bdd-c67c-45fe-8313-fd1226e74629 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.044540 Sep 09 01:48:42.356003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 30/51] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:42 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:42.362264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dc91d4b2-6f4f-4e44-a948-d24401af7fd2 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8a70f70>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:42.394997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ea7ccdb8-6610-4524-86c8-6681d94c8897 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.011332 Sep 09 01:48:42.395724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 22/52] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:48:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:48:42.432510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dc91d4b2-6f4f-4e44-a948-d24401af7fd2 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.073075 Sep 09 01:48:42.436394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 31/53] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:42 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:42.445397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5836d110-93c9-4d0f-868d-488e76bb3ee3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:42.446049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5836d110-93c9-4d0f-868d-488e76bb3ee3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:42.561431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5836d110-93c9-4d0f-868d-488e76bb3ee3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:42.575306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5836d110-93c9-4d0f-868d-488e76bb3ee3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1236 microversion: 2.1 time: 0.135746 Sep 09 01:48:42.578156 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 23/54] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:42 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1236 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:43.213540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:43.214164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:43.221762 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.227079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.228040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.229001 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.229717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.230368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.324546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:43.335380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:43.336003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:43.349361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.351228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-850c2082-8a3d-452f-a28d-aadeb07e7e71 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1267 microversion: 2.1 time: 0.143153 Sep 09 01:48:43.352020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.352667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.353417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.354191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 32/55] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:43 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:43.354848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.355461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.369142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6952dd45-7069-4a31-b1db-a13bb05f46b4 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8abeca0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:43.452917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6952dd45-7069-4a31-b1db-a13bb05f46b4 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 200 len: 287 microversion: 2.1 time: 0.088811 Sep 09 01:48:43.453676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 33/56] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:43 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:43.459730 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2167a9d8-e0ac-4804-b530-e3f698a599d6 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d8ab2d30>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:43.486144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:43.514229 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cfb103dc-47c0-489f-9c3d-150eeef3a295 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1218 microversion: 2.1 time: 0.182886 Sep 09 01:48:43.536875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 24/57] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:43 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1218 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:43.606260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:43.607119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:43.622179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.624128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.625545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.628410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:43.630734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:43.631892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:43.634938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2167a9d8-e0ac-4804-b530-e3f698a599d6 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 200 len: 352 microversion: 2.1 time: 0.179870 Sep 09 01:48:43.642782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 34/58] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:43 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 352 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:43.764713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:43.777137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a8327e6f-c332-4364-9979-4f01e3f30389 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1232 microversion: 2.1 time: 0.178295 Sep 09 01:48:43.779470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 25/59] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:43 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1232 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:44.382843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.383915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:44.405794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.406661 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.407694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.408766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.409630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.410386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.472187 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7c267d57-5019-46ba-b51b-ffbafa11bd5e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8b1d700>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.544425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-7c267d57-5019-46ba-b51b-ffbafa11bd5e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] HTTP exception thrown: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7c267d57-5019-46ba-b51b-ffbafa11bd5e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Request method failure captured: Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea HTTP/1.1 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptljs3u2lnYG1yaVp5ML92YBXq8Typ9bbZtmgpfk6JeO3TMZ8VZncgujlpk9G6HvkRFd8ZaNUmpN_wnMi08Kf7Vlw92Dkx0QZCfhaz44WRNjkUjyBA97taequgBCtxHJ_TEUbeeMcQYm-lMbyoiehpmy3TiweP_SeU0Jzv73p3nbIw Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:48:44.549442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daa9c339892144d281422ad480383a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daa9c339892144d281422ad480383a22", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: c8f3463f4c534fa7b2a87e5cac6c3a70 Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '74533a35-fcfd-4855-8005-7a18e649f2ea'} Sep 09 01:48:44.551148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. (HTTP 404) (Request-ID: req-2c7df6ab-f6ea-420d-b2f1-eb2834bc4d4c) Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.553024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:44.554460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 01:48:44.556279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. Sep 09 01:48:44.558832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.562194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7c267d57-5019-46ba-b51b-ffbafa11bd5e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Returning 404 to user: Snapshot 74533a35-fcfd-4855-8005-7a18e649f2ea could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:48:44.566336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7c267d57-5019-46ba-b51b-ffbafa11bd5e tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea" status: 404 len: 111 microversion: 2.1 time: 0.104133 Sep 09 01:48:44.568184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 26/60] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/os-snapshots/74533a35-fcfd-4855-8005-7a18e649f2ea => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:48:44.575792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.577927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:44.585768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.586564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.587222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.588139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.588794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.589518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.632376 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:44.646334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8a7c1b63-3943-4e72-9c6d-180ccbaa36b5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1273 microversion: 2.1 time: 0.270654 Sep 09 01:48:44.646950 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 35/61] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:44.673992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b2654e3d-ffcd-43a7-9bfe-f9492910e06f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8a0cee0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.747765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:44.766115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b28efce9-8b09-4ad9-9b0b-b057bf4ab89f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1274 microversion: 2.1 time: 0.196501 Sep 09 01:48:44.782277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 27/62] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:44.795232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-48f6e3c7-73d4-4a31-b43e-4b89154914f3 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Calling method '.version_select at 0x7f87d89e8c10>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.862825 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b2654e3d-ffcd-43a7-9bfe-f9492910e06f tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 202 len: 0 microversion: 2.1 time: 0.206401 Sep 09 01:48:44.864464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 36/63] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:48:44 2022] DELETE /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:48:44.872442 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:44.873749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:44.907968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.910202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.911430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.914892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:44.915933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:44.916831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:44.946424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-48f6e3c7-73d4-4a31-b43e-4b89154914f3 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] HTTP exception thrown: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-48f6e3c7-73d4-4a31-b43e-4b89154914f3 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Request method failure captured: Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 HTTP/1.1 Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptluakV_ebQyLr18a1YEElUwcKqKUqAG5BHMvkck2SJ3MJfrNrOdTXlQfOWz-gIsQQ1qnuNwP_o1i3tkOgxLKyrdvAmxu_oGJyPOXNrn7w2wFH_qBxrTEcQGOO5d6pgZeqUsZQKFDHyw8UL9mUBpuNrTLkQ-_K-9FCLKQ74vbErXbk Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 6d01372b1bdb420fbdbda8d44285fbbe Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesGetTestJSON-1116755531 Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:48:44.948773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6d01372b1bdb420fbdbda8d44285fbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d01372b1bdb420fbdbda8d44285fbbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6d01372b1bdb420fbdbda8d44285fbbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6d01372b1bdb420fbdbda8d44285fbbe", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesGetTestJSON-1116755531 Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 6d01372b1bdb420fbdbda8d44285fbbe Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesGetTestJSON-1116755531 Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesGetTestJSON-1116755531-project Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 98e198600f974feaaa0e62a23d690f25 Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesGetTestJSON-1116755531-project Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '9211ba73-22bd-46cd-bacb-ab33351da116'} Sep 09 01:48:44.949877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. (HTTP 404) (Request-ID: req-7dc40d78-5400-4077-9a30-8c8fd0868b10) Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.950657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:44.951573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 01:48:44.952458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:44.953424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-48f6e3c7-73d4-4a31-b43e-4b89154914f3 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] Returning 404 to user: Volume 9211ba73-22bd-46cd-bacb-ab33351da116 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:48:44.969049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-48f6e3c7-73d4-4a31-b43e-4b89154914f3 tempest-VolumesGetTestJSON-1116755531 tempest-VolumesGetTestJSON-1116755531-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116" status: 404 len: 109 microversion: 2.1 time: 0.165303 Sep 09 01:48:44.969693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 28/64] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/os-volumes/9211ba73-22bd-46cd-bacb-ab33351da116 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:48:44.992761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-18c7d24a-a444-4ae6-9ff3-eaa4d26121d1 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8a1a160>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:45.091593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-18c7d24a-a444-4ae6-9ff3-eaa4d26121d1 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 200 len: 345 microversion: 2.1 time: 0.119101 Sep 09 01:48:45.092483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 29/65] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:48:45.244555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:45.252569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a8f41511-3f0b-4fc9-9903-70e6cc94cc3c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1232 microversion: 2.1 time: 0.386073 Sep 09 01:48:45.258741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 37/66] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:44 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1232 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:45.673458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:45.674800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:45.695201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:45.698842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:45.699540 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:45.701319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:45.706408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:45.706874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:45.799671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:45.800319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:45.829210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:45.851538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:45.852007 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:45.852755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:45.853267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:45.853679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:46.251409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:46.259273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b291da13-84c7-4cf1-91f3-6f4eaaba23b6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.468939 Sep 09 01:48:46.259901 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 38/67] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:45 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:46.273582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-008b84a4-f1a5-424b-b7ac-0d9cf34ea590 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d8a628b0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:46.317633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-008b84a4-f1a5-424b-b7ac-0d9cf34ea590 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] HTTP exception thrown: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-008b84a4-f1a5-424b-b7ac-0d9cf34ea590 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Request method failure captured: Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 HTTP/1.1 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptljs3u2lnYG1yaVp5ML92YBXq8Typ9bbZtmgpfk6JeO3TMZ8VZncgujlpk9G6HvkRFd8ZaNUmpN_wnMi08Kf7Vlw92Dkx0QZCfhaz44WRNjkUjyBA97taequgBCtxHJ_TEUbeeMcQYm-lMbyoiehpmy3TiweP_SeU0Jzv73p3nbIw Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:48:46.328176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daa9c339892144d281422ad480383a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daa9c339892144d281422ad480383a22", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: c8f3463f4c534fa7b2a87e5cac6c3a70 Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '77640520-6aa5-405d-a17d-1188dc743189'} Sep 09 01:48:46.329375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. (HTTP 404) (Request-ID: req-599fb402-04fb-4341-b951-460c522d2bbb) Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.330026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:46.331100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 01:48:46.331978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.332971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.335326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-008b84a4-f1a5-424b-b7ac-0d9cf34ea590 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Returning 404 to user: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:48:46.336401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-008b84a4-f1a5-424b-b7ac-0d9cf34ea590 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 404 len: 109 microversion: 2.1 time: 0.075586 Sep 09 01:48:46.343537 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 39/68] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:46 2022] GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:48:46.351131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:46.351916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:46.359681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:46.360181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:46.360616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:46.361339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:46.361954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:46.362600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:46.394678 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:46.402997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-82a844a2-60d4-4c3d-8c58-52ba8e3a59fe tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.734473 Sep 09 01:48:46.403574 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 30/69] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:45 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:46.418001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-29a2f5de-fdd3-461b-9aa9-dfd1797ead53 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d89d1dc0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:46.465591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-29a2f5de-fdd3-461b-9aa9-dfd1797ead53 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] HTTP exception thrown: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-29a2f5de-fdd3-461b-9aa9-dfd1797ead53 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Request method failure captured: Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 HTTP/1.1 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptljs3u2lnYG1yaVp5ML92YBXq8Typ9bbZtmgpfk6JeO3TMZ8VZncgujlpk9G6HvkRFd8ZaNUmpN_wnMi08Kf7Vlw92Dkx0QZCfhaz44WRNjkUjyBA97taequgBCtxHJ_TEUbeeMcQYm-lMbyoiehpmy3TiweP_SeU0Jzv73p3nbIw Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:48:46.467797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daa9c339892144d281422ad480383a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daa9c339892144d281422ad480383a22", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: c8f3463f4c534fa7b2a87e5cac6c3a70 Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '77640520-6aa5-405d-a17d-1188dc743189'} Sep 09 01:48:46.469126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. (HTTP 404) (Request-ID: req-12a7f946-9c73-428b-9362-4f5b11b5246e) Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.469928 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:48:46.471032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 01:48:46.472294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.475629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.476729 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-29a2f5de-fdd3-461b-9aa9-dfd1797ead53 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Returning 404 to user: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:48:46.481321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-29a2f5de-fdd3-461b-9aa9-dfd1797ead53 tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 404 len: 109 microversion: 2.1 time: 0.073590 Sep 09 01:48:46.486543 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 31/70] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:48:46 2022] DELETE /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:48:46.490244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:46.494599 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67f2181c-d4e8-4821-b491-ffc54d74c0ef tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Calling method '.version_select at 0x7f87d894af70>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:46.502560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cf2a4ff9-2d72-4ceb-8fb9-75201015f0c8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.157245 Sep 09 01:48:46.503472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 40/71] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:46 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:46.551641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-67f2181c-d4e8-4821-b491-ffc54d74c0ef tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] HTTP exception thrown: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67f2181c-d4e8-4821-b491-ffc54d74c0ef tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Request method failure captured: Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 HTTP/1.1 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptljs3u2lnYG1yaVp5ML92YBXq8Typ9bbZtmgpfk6JeO3TMZ8VZncgujlpk9G6HvkRFd8ZaNUmpN_wnMi08Kf7Vlw92Dkx0QZCfhaz44WRNjkUjyBA97taequgBCtxHJ_TEUbeeMcQYm-lMbyoiehpmy3TiweP_SeU0Jzv73p3nbIw Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:48:46.554272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/daa9c339892144d281422ad480383a22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/daa9c339892144d281422ad480383a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_daa9c339892144d281422ad480383a22", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: daa9c339892144d281422ad480383a22 Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790872912 Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: c8f3463f4c534fa7b2a87e5cac6c3a70 Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790872912-project Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '77640520-6aa5-405d-a17d-1188dc743189'} Sep 09 01:48:46.555315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. (HTTP 404) (Request-ID: req-b73ee2eb-07ca-4fb5-997b-a6033d6acabd) Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.555926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:48:46.556805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 01:48:46.557722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:48:46.558668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67f2181c-d4e8-4821-b491-ffc54d74c0ef tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] Returning 404 to user: Volume 77640520-6aa5-405d-a17d-1188dc743189 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:48:46.560667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-67f2181c-d4e8-4821-b491-ffc54d74c0ef tempest-VolumesSnapshotsTestJSON-1790872912 tempest-VolumesSnapshotsTestJSON-1790872912-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189" status: 404 len: 109 microversion: 2.1 time: 0.071292 Sep 09 01:48:46.560667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 32/72] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:48:46 2022] GET /compute/v2.1/os-volumes/77640520-6aa5-405d-a17d-1188dc743189 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:48:47.283873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:47.285180 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:47.294306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:47.297215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.298416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.299784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.301580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.302270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.303655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.403155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:47.411469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2c23a5ca-8065-45bd-96cd-67da04891515 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.131255 Sep 09 01:48:47.421769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 41/73] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:47 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:47.429203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:47.429203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:47.440756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.442040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.442896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.443673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.444270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.444699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.535504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:47.535504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:47.545910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.546398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.546830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.547521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:47.547973 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:47.548387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:47.701584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:47.709975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5ad00805-ebbf-44e2-83bf-0254e9617e5f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.186863 Sep 09 01:48:47.710570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 42/74] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:47 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:47.715188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:47.732777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-95158e9d-e83d-46d6-b834-43e487c80b20 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.305487 Sep 09 01:48:47.733434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 33/75] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:47 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:48.440009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:48.440615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:48.450243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.453969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.454515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.455449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.456076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.457082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.550561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:48.559350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c84fa74b-60d0-49f4-91bb-049b294cb466 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.125581 Sep 09 01:48:48.560400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 43/76] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:48 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:48.733220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:48.733840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:48.746716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.747235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.748252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.748980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.751166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.751778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.758924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:48.759750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:48.769504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.770233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.771063 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.772361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:48.773365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:48.773925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:48.906900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:48.922558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5eb260ce-5864-4594-ac04-c8d4d7d93e03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.193794 Sep 09 01:48:48.923147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 34/77] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:48 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:49.091522 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:49.099677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5da715de-9ae6-4d41-a447-d36240f793d4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.345761 Sep 09 01:48:49.101752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 44/78] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:48 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:49.588042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:49.588647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:49.594654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:49.595423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:49.595858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:49.597212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:49.597698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:49.598099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:49.679197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:49.689812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8aeed563-6f24-4305-8c40-9af66474285e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.106222 Sep 09 01:48:49.690616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 35/79] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:49 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:49.949652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:49.950261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:49.952175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=12 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:49.957653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:49.958138 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:49.958569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:49.959251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:49.959703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:49.960119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:50.027638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:50.036536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c11e79f3-3a48-407c-b875-06d0f5faf955 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.090866 Sep 09 01:48:50.037123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 45/80] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:49 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:50.124389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:50.124992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:50.130983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:50.131471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:50.131945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:50.132812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:50.133336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:50.133765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:50.267962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:50.277172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e8a2d5d3-3a86-4cde-b6f3-b241c7b7d958 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.157267 Sep 09 01:48:50.277758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 36/81] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:50 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:50.713488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:50.714096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:50.720832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:50.721556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:50.721979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:50.722881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:50.723319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:50.723889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:50.794448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:50.802255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bd4ca149-99c3-44dd-8f11-0b7413da8a3e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.092476 Sep 09 01:48:50.803778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 46/82] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:50 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:51.060109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:51.060879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:51.067820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.068270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.068873 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.069802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.070461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.070944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.161903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:51.170333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-95152e46-b7a4-4155-a950-bddd317a9a5d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.114259 Sep 09 01:48:51.170907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 37/83] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:51 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:51.301156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:51.301830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:51.308096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.308898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.309398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.310164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.310700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.311258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.482484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:51.490300 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3d29549a-51c7-4339-8d61-a648766ec0a1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.193527 Sep 09 01:48:51.490805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 47/84] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:51 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:51.827824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:51.828433 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:51.834963 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.835454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.835885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.836567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:51.837183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:51.837638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:51.903933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:51.911842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-afd8450a-afef-4e76-94ef-b2c6994a7646 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.087862 Sep 09 01:48:51.912486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 38/85] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:51 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:52.213679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:52.214770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:52.227968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.230733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.231412 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:52.233585 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.235501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.236733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:52.279365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:52.352891 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:52.363434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2196e4bf-5246-49cc-af7f-e0c67ccf6fd2 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.174060 Sep 09 01:48:52.364024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 48/86] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:52 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:52.514491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:52.515002 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:52.517035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:52.523184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.525645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.526096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:52.526845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.527301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.527718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:52.571182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=26 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:52.699448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:52.711884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0ce408e1-96c6-4964-9cf8-16ff4577e4a5 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.201797 Sep 09 01:48:52.712567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 39/87] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:52 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:52.934199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:52.934800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:52.940688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.941206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.941635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:52.942303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:52.942749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:52.943162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:53.006650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:53.014152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1599e79a-3434-47d1-86b8-587ef3fd1532 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.083730 Sep 09 01:48:53.014708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 49/88] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:52 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:53.391080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:53.391793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:53.398785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:53.399902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:53.400693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:53.401646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:53.402287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:53.402902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:53.483280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:53.490893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7a4f2028-14d2-4b38-b26e-679ae8cfe12f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.106940 Sep 09 01:48:53.491443 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 40/89] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:53 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:53.734843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:53.735394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:53.741321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:53.741802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:53.742232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:53.742912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:53.743362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:53.743775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:53.888553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:53.899619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ab267cb2-e46c-418f-9639-4bfe73439485 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.168699 Sep 09 01:48:53.900425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 50/90] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:53 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:54.035826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:54.037175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:54.043499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.044213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.044639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:54.045360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.045816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.050058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:54.110903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:54.118842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-da0dc49c-d83f-4a15-8687-62516d5f4948 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.086787 Sep 09 01:48:54.119392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 41/91] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:54 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:54.513032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:54.513594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:54.519535 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.520027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.520463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:54.521175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.521632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.522052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:54.584978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:54.592808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7f19bedb-3172-4278-8144-e47ed2ef4707 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.083684 Sep 09 01:48:54.593467 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 51/92] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:54 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:54.923714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:54.924327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:54.927716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:54.931744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.932227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.932665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:54.933378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:54.933831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:54.934251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:55.062137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:55.070315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ddda6405-d393-452d-890f-d0f27df9fb1f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.150623 Sep 09 01:48:55.070885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 42/93] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:54 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:55.141279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:55.141889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:55.147845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:55.148322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:55.148748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:55.149454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:55.149906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:55.150317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:55.210244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:55.219083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-240b1438-e80d-4f93-beaf-d51ff150ca10 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.081548 Sep 09 01:48:55.219690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 52/94] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:55 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:55.618880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:55.619590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:55.626140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:55.626722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:55.627261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:55.628081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:55.628638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:55.629726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:55.650120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:48:55.697209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:55.706147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2b8678ea-64a1-49b2-b9f9-ded807082578 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.091208 Sep 09 01:48:55.707043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 43/95] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:55 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:56.092301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:56.092913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:56.098928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.099413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.099851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.100530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.100983 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.101432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.242833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:56.243420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:56.249185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:56.250384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.250941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.251405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.252094 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.252542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.252957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.257603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9d73c76d-61ff-4138-81eb-7a0d14f55726 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.169112 Sep 09 01:48:56.258255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 53/96] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:56 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:56.315748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:56.324213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ecfc426c-85c8-4246-a60c-bc9d34d93071 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.085777 Sep 09 01:48:56.325109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 44/97] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:56 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:56.730333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:56.731054 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:56.737945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.739287 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.739804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.740617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:56.741176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:56.741677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:56.804448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:56.811938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f3604069-c232-4522-acec-07ec3364e90c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.085977 Sep 09 01:48:56.812501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 54/98] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:56 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:57.280063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:57.280668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:57.287190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.287670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.288098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.288775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.289257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.289675 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.347013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:57.348203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:57.354379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.355107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.355550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.356415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.357015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.357818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.425231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:57.432612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9941e60f-79ce-4a80-913d-a62f8ce0c05e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.089475 Sep 09 01:48:57.433192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 55/99] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:57 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:57.441723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:57.449314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a3a6f2da-0e2d-4bf2-8fd6-33ee72278bbd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.173018 Sep 09 01:48:57.450120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 45/100] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:57 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:57.834924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:57.835744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:57.844663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.845192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.845629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.846353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:57.846810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:57.847229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:57.914437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:57.928916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-566b2122-e0f4-4ec8-87c4-4caf6f8b64ba tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.098250 Sep 09 01:48:57.929671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 56/101] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:57 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:58.455792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:58.456616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:58.464550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.465500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.466193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:58.466996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.467725 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.468463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:58.473589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:58.474232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:58.482079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.484982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.485469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:58.487483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.489401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.489790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:58.615591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:58.625707 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-82ee2600-28c7-4bfe-955d-3a0674d7ee5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.173600 Sep 09 01:48:58.626470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 46/102] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:58 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:58.726777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:58.735188 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-534f1dc7-6c7b-47d5-9966-d3d553437e8f tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.265607 Sep 09 01:48:58.735755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 57/103] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:58 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:48:58.952001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:58.952653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:58.958746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.959235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.959671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:58.960359 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:58.960817 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:58.961267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:59.033584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:59.042216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-80247774-4dd9-4390-81c2-532784d72c2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.094073 Sep 09 01:48:59.048541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 47/104] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:58 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:59.652986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:59.657155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:59.664070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:59.664574 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:59.665008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:59.665929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:59.666389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:59.666810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:59.747611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:59.759967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:48:59.761481 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:48:59.768699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:59.769959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:59.770660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:59.771869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:48:59.772401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:48:59.773041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:48:59.774466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-20fed5f2-9d5c-47b5-a561-161a445dec75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.128678 Sep 09 01:48:59.777845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 58/105] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:59 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:48:59.929664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:48:59.939525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7acd8733-2ba5-41fd-953f-2d6c9065133b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.183484 Sep 09 01:48:59.940249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 48/106] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:48:59 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:00.065903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:00.066534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:00.072978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.073501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.073954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:00.074653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.075273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.075716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:00.141947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:00.150301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8379108c-f566-40f4-8c92-2eed2ae4f94a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.088110 Sep 09 01:49:00.150888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 59/107] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:00 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:00.808272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:00.808272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:00.815876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.815876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.815876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:00.815876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.816375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.826670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:00.928559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a002520d-d0f4-4b12-889b-f513bb1a7aa9 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8abeaf0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:00.934915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:00.943957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a8d4627c-b71f-4441-bd32-fdde47ce9194 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.148022 Sep 09 01:49:00.951964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 49/108] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:00 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:00.968931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:00.969743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:00.978582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.979196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.979813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:00.980632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:00.981381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:00.981901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:01.013796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a002520d-d0f4-4b12-889b-f513bb1a7aa9 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/490b074e-2b5f-48d9-bfa8-fa43b912e5ee" status: 200 len: 351 microversion: 2.1 time: 0.088918 Sep 09 01:49:01.028653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 60/109] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:49:00 2022] GET /compute/v2.1/os-volumes/490b074e-2b5f-48d9-bfa8-fa43b912e5ee => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:01.171073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:01.177116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:01.182040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:01.188895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-baaf367a-36ab-4da2-bef5-3fbbc0c425cd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.225332 Sep 09 01:49:01.195365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 50/110] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:00 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:01.196364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:01.197010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:01.197633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:01.198493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:01.199085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:01.199651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:01.319097 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:01.328034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-071466dd-2cc1-48a8-a2d7-6afc5ae6fb7e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.155365 Sep 09 01:49:01.329593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 61/111] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:01 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:01.968422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:01.969286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:01.976645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:01.977504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:01.978206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:01.978915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:01.979415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:01.979879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:02.045701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:02.055739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-883f1c41-42ee-4625-9fba-cec4f03cdc4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.091582 Sep 09 01:49:02.056311 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 51/112] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:01 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:02.216668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:02.217297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:02.219103 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:02.233989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:02.234460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:02.234886 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:02.235586 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:02.236035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:02.236450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:02.356601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:02.357281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:02.363839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:02.364960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:02.365812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:02.366755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:02.367598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:02.368204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:02.410531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:02.425817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2e9dd26d-cfbd-4e84-8e5d-538953cc9fd8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.208893 Sep 09 01:49:02.426656 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 62/113] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:02 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:02.460768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:02.468873 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f2a4d7c7-36a1-4067-8c44-2a615d90170f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.116006 Sep 09 01:49:02.469487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 52/114] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:02 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:03.077944 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:03.079025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:03.086203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.086691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.087124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.087999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.088459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.088882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.168844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:03.177251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ed7ccdb0-7c99-406b-9ea1-c335a88c6ad1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.103298 Sep 09 01:49:03.177809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 63/115] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:03 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:03.451930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:03.452621 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:03.460758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.461356 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.461738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.462507 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.463182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.463902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.494510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:03.495123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:03.505303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.505781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.506203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.506915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:03.507370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:03.507954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:03.619292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:03.630666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4c57d918-d36d-4f55-8c9c-8b1c985f0253 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.140622 Sep 09 01:49:03.631469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 64/116] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:03 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:03.676128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:03.685301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-46dbf4e1-e38a-4007-b997-7aa3ed0f4ad8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.237900 Sep 09 01:49:03.686083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 53/117] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:03 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:04.199528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:04.200140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:04.206026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.206510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.206943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.207645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.208320 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.208747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.275175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:04.278961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:04.284032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b6c42666-3716-46c1-8e46-09ecc693854b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.088322 Sep 09 01:49:04.284597 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 65/118] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:04 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:04.654281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:04.654987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:04.660799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.661830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.662255 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.662926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.663371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.663782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.711582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:04.712402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:04.721526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.722158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.722701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.723539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:04.724038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:04.724435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:04.732431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:04.741327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-09d86a5e-f4bf-40eb-b91c-f6f331c6a06c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.091100 Sep 09 01:49:04.741950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 54/119] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:04 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:04.860746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:04.870599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-27bb7ecb-3db5-4ef1-bb35-a0c73969531b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.163898 Sep 09 01:49:04.871204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 66/120] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:04 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:05.307526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:05.308215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:05.314437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.315099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.315528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:05.316207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.316653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.317721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:05.377502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:05.386097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-796cdf94-be6e-45d9-8382-cbaf3d246b1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.082298 Sep 09 01:49:05.386667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 55/121] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:05 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:05.763460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:05.764061 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:05.770026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.770499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.770922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:05.771592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.772036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.772449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:05.832048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:05.839489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1980ff63-a9a7-45af-b686-98b0bd55a43c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.079794 Sep 09 01:49:05.840051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 67/122] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:05 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:05.893386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:05.894132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:05.900060 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.900574 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.901005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:05.901711 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:05.902166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:05.902583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:06.028786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:06.036871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-45e42910-42f9-4326-9a79-1e8dfa4c24aa tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.147224 Sep 09 01:49:06.037461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 56/123] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:05 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:06.407672 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:06.408196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:06.414122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:06.414630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:06.415062 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:06.415733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:06.416179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:06.416596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:06.477719 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:06.485080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-17c41d90-c823-45b8-8b22-c9376fb5cc95 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.081249 Sep 09 01:49:06.485631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 68/124] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:06 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:06.862129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:06.862733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:06.868570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:06.869052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:06.869507 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:06.870180 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:06.870626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:06.871041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:06.932284 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:06.940626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f4fcb1ee-6f94-424c-8041-79d163d519ef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.082357 Sep 09 01:49:06.941199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 57/125] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:06 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:07.058310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:07.059242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:07.065126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:07.065610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:07.066043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:07.066716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:07.067171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:07.067586 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:07.217729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:07.227512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-95eb42df-2ee5-435f-8d80-0a979c5b9bfb tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.172966 Sep 09 01:49:07.243344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 69/126] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:07 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:07.508622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:07.509280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:07.515835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:07.516429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:07.516929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:07.517727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:07.518272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:07.518760 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:07.831635 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:07.840246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d8173f20-0a8a-4eff-ad01-9de6dc808dbc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1280 microversion: 2.1 time: 0.336267 Sep 09 01:49:07.841433 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 58/127] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:07 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1280 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:07.984302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:07.985246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:08.003618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.004136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.004731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.005538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.005991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.006653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.117701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:08.125611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c13fc709-2b1f-46ee-b16f-0b7e1b85663a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1288 microversion: 2.1 time: 0.154288 Sep 09 01:49:08.140123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 70/128] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:07 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1288 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:08.255088 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:08.256554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:08.268221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.269750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.271296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.273661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.274361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.275529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.746564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:08.769178 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1b8f909c-5eea-411e-9437-0a6497d84ef6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.518248 Sep 09 01:49:08.771492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 59/129] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:08 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:08.863854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:08.864813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:08.873821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.874776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.875533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.876465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:08.877177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:08.877821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:08.915712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fe098569-b5d9-497b-a7f0-d7b4d4446c93 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d89e8310>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:08.969434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fe098569-b5d9-497b-a7f0-d7b4d4446c93 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5f896180-8591-4c76-b7c4-00f5b3a64a77" status: 200 len: 351 microversion: 2.1 time: 0.060951 Sep 09 01:49:08.973955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 60/130] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:49:08 2022] GET /compute/v2.1/os-volumes/5f896180-8591-4c76-b7c4-00f5b3a64a77 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:09.167914 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:09.168529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:09.175380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.175886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.176340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.177713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.178453 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.179191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.184693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:09.280610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:09.294068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ae743915-860a-474b-ba49-390dbabfd8ad tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.432011 Sep 09 01:49:09.294513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 71/131] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:08 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:09.320672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:09.335775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-76eefee5-8962-44a4-81b7-6363d5d28981 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1294 microversion: 2.1 time: 0.172745 Sep 09 01:49:09.336391 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 61/132] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:09 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1294 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:09.693632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00901855-faa9-4125-875b-927658be9ccd", "tag": "83e9b084-f05c-44c4-9172-e61d551a8835"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:09.713392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.714360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.715142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.752763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Creating event network-changed:83e9b084-f05c-44c4-9172-e61d551a8835 for instance 00901855-faa9-4125-875b-927658be9ccd on hv-cinder-85221 Sep 09 01:49:09.753660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 01:49:09.754881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b1079883-662a-4eb7-bdbf-424f7f4ab68d req-a1b3a01e-e105-41e4-bac4-dfa8643153da service nova] Acquired lock "compute-rpcapi-router" {{(pid=126895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 01:49:09.756136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.757002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.757775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.759000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.759853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.760913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.773559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.compute.rpcapi [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 01:49:09.774694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] Releasing lock "compute-rpcapi-router" {{(pid=126895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 01:49:09.813916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-346f8fed-6216-4751-ab06-318a0ad54d7e None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181941 Sep 09 01:49:09.815700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc7b518-07bb-4875-9e60-f41f7b2c7f37", "tag": "11df9340-6e9d-409c-909e-a7dad07fffe3"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:09.816590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 72/133] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:49:09.828902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:09.829822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:09.831069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.831756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.833413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.850576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.851084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.856330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Creating event network-changed:11df9340-6e9d-409c-909e-a7dad07fffe3 for instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 on hv-cinder-85221 Sep 09 01:49:09.856943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.857393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 01:49:09.857942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.858172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5a234eb5-dc35-4756-8e1b-9da2424102e0 req-ef0f9ded-c0ca-42d1-b503-385c90bb6731 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 01:49:09.858425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.858859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.859855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.860737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.861626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.862896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:09.864328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:09.864944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:09.875297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.compute.rpcapi [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 01:49:09.876512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] Releasing lock "compute-rpcapi-router" {{(pid=126896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 01:49:09.904306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3f156da8-bc1e-4a17-a97f-357c5291acd4 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199127 Sep 09 01:49:09.905310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 62/134] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:10.322633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:10.323322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:10.329825 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:10.330435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:10.330907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:10.331585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:10.332032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:10.332875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:10.468112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:10.476540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-489ad946-f0ef-437e-a49d-d62643ad5e4b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.657966 Sep 09 01:49:10.489370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 73/135] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:09 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:10.489370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:10.489370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:10.489370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:10.489370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:10.490128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:10.490992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:10.491615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:10.492237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:10.592054 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:10.600118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-96f9265d-abdf-4f42-88f0-0cc1386e1bb6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1294 microversion: 2.1 time: 0.121834 Sep 09 01:49:10.600697 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 74/136] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:10 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:10.612741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:10.620736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7a36e958-050b-44c3-924f-c2b97749abd5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.302768 Sep 09 01:49:10.621321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 63/137] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:10 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:11.483448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-83bd07e6-31a2-4800-9601-832fc79199e7 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d89403a0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.500231 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.500835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:11.512986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.513380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.513806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.514664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.515123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.515541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.534271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-83bd07e6-31a2-4800-9601-832fc79199e7 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2d7e169f-068c-4aed-b6cc-c2836e8a7a92" status: 200 len: 351 microversion: 2.1 time: 0.054466 Sep 09 01:49:11.534870 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 75/138] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/os-volumes/2d7e169f-068c-4aed-b6cc-c2836e8a7a92 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:11.548309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8c3ca965-2b5e-491a-9218-204857409efc tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d89cd430>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.643392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8c3ca965-2b5e-491a-9218-204857409efc tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.098586 Sep 09 01:49:11.644146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 76/139] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:11.650609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.651264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:11.661858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.662354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.662787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.663518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.663975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.664902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.685593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:11.694863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-87545a1f-c580-498d-a4fe-f0608bd0ee6d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.199037 Sep 09 01:49:11.695546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 64/140] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:11.709128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.709933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:11.716569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.717129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.717532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.718231 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:11.718687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:11.719109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:11.873938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:11.882845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1b21a2ab-27f9-44c2-8211-ab9d31b3c5df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.235098 Sep 09 01:49:11.883436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 77/141] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:11.888246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-68c97c33-4201-403a-b65a-a43a1ea129c7 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d89cd3a0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:11.901296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:11.910030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-59f28cf8-1f2f-472c-86b8-f7747fe65533 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.211709 Sep 09 01:49:11.911049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 65/142] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:11.979254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-68c97c33-4201-403a-b65a-a43a1ea129c7 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094782 Sep 09 01:49:11.979972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 78/143] 10.222.0.15 () {58 vars in 1149 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:11.995871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b7e4fcec-0c11-44d2-9850-cf9e911391b8 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d89d1b80>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.080903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b7e4fcec-0c11-44d2-9850-cf9e911391b8 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089813 Sep 09 01:49:12.082783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 66/144] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Sep 9 01:49:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:12.096533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7b04628c-2d4c-4e46-b334-4f3abb94069e tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8a3e5e0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.155950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10c908e-1792-46e9-ae0a-6727f8bf4923", "tag": "11b14534-43ce-4d43-b397-4294269046b0"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:12.167401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.168093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.168681 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.179143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] Creating event network-changed:11b14534-43ce-4d43-b397-4294269046b0 for instance f10c908e-1792-46e9-ae0a-6727f8bf4923 on hv-cinder-85221 Sep 09 01:49:12.184653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-81cb8814-8c64-4022-baee-912a511de64b req-12a809a6-cf87-48b3-9ca6-c73d7160bcfd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Sep 09 01:49:12.185446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 67/145] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:12.215631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7b04628c-2d4c-4e46-b334-4f3abb94069e tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.122788 Sep 09 01:49:12.216359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 79/146] 10.222.0.15 () {58 vars in 1167 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:12.234671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1d0f03da-aeb5-42a9-82b4-bdd86655d9a5 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8939b80>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.382479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1d0f03da-aeb5-42a9-82b4-bdd86655d9a5 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.155268 Sep 09 01:49:12.383061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 68/147] 10.222.0.15 () {58 vars in 1170 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:12.400434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5231c294-5dfa-437f-b83f-86507a7b78b4 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8a3e3a0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.507784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5231c294-5dfa-437f-b83f-86507a7b78b4 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.112841 Sep 09 01:49:12.509183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 80/148] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:12.523217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5a59b025-0138-4a51-a99b-67d35e7d36b6 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8a1a4c0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.624176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5a59b025-0138-4a51-a99b-67d35e7d36b6 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104870 Sep 09 01:49:12.624821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 69/149] 10.222.0.15 () {58 vars in 1188 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:12.638947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-45c3c046-6a14-4349-b29c-cefd30c3ca92 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] Calling method '.version_select at 0x7f87d8a2aee0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.717648 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.718535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:12.725997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.726823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.727266 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.728003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.728438 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.728861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.853353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-45c3c046-6a14-4349-b29c-cefd30c3ca92 tempest-VolumesTestJSON-1436236352 tempest-VolumesTestJSON-1436236352-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.218046 Sep 09 01:49:12.853928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 81/150] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:12.869605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:12.877561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-eeaaa582-b2ac-4382-8dd0-09acd32f2ac6 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.163970 Sep 09 01:49:12.878132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 70/151] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:12.906994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.907607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:12.915283 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.915826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.916410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.918198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.918590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.926489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.936512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:12.937378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:12.947334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.947823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.948281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:12.948971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:12.949448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:12.949860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:13.140479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:13.147872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:13.149281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9763f919-5e22-48c3-87a7-bb0848b20fc3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.246588 Sep 09 01:49:13.149935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 82/152] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:13.155741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6384bea2-e573-4fb6-8c8e-e2ad7c981d4f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.223011 Sep 09 01:49:13.156316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 71/153] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:12 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:13.900302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:13.900914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:13.907279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:13.907799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:13.908230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:13.908934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:13.909419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:13.909880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:14.039914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:14.047447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-937365ce-2de7-4b4d-ae2d-030c48cdfc78 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.151054 Sep 09 01:49:14.048003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 83/154] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:13 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:14.171041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:14.171826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:14.177504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:14.177996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:14.178121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:14.178479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:14.178903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:14.179580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:14.180027 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:14.180471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:14.183799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:14.184279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:14.184703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:14.185409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:14.185856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:14.186266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:14.376403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:14.380261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:14.384608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ef858b46-7a89-4e32-890c-7dde75a251fb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.217388 Sep 09 01:49:14.385196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 72/155] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:14 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:14.388271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-08564428-0583-4f12-ab1b-f2e5027b5d83 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.214448 Sep 09 01:49:14.388912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 84/156] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:14 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:15.069560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:15.070168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:15.076136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.076609 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.077032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.077744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.078188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.078599 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.204794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:15.212829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a032d62c-b1d4-4726-8b8e-dc91b59d1781 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.146969 Sep 09 01:49:15.213458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 73/157] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:15 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:15.406541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:15.407043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:15.410615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:15.411215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:15.413325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.413821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.414254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.414976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.415431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.415852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.417019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.417523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.417943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.418610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:15.419054 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:15.419465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:15.616058 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:15.619392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:15.623997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5e67e908-faba-4aff-9d8e-61a2c9350166 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.221329 Sep 09 01:49:15.624562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 85/158] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:15 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:15.627203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-077c97d1-dda4-4d79-ae3a-5baf1028abcc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.220298 Sep 09 01:49:15.627850 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 74/159] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:15 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:16.235386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:16.235991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:16.243044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.243527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.244033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.244899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.245388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.245807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.377359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:16.395233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f5799ba1-9d57-4b11-8bf8-502c2fe07e41 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.163442 Sep 09 01:49:16.395825 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 86/160] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:16 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:16.646445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:16.646949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:16.649531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:16.650139 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:16.652872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.653390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.653824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.654513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.654970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.655390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.655894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.656365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.656787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.657481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:16.657928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:16.658337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:16.850442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:16.856865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:16.858222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-741cac53-979b-4665-8b6e-ccdbb1e08212 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.215864 Sep 09 01:49:16.860592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 75/161] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:16 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:16.865414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0b272d41-6942-4dab-a111-165896a78f9d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.219522 Sep 09 01:49:16.865972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 87/162] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:16 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:17.418886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:17.419491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:17.425313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.426287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.426717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:17.427384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.427828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.428249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:17.823175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:17.835952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-184d44ce-29be-4cba-ad21-6ffed464ac60 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.420669 Sep 09 01:49:17.838895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 76/163] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:17 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:17.881008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:17.881703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:17.888482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:17.889398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:17.908826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.909355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.909790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:17.911105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.912771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.913215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.913646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:17.914341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:17.914791 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.915202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:17.920029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:17.920478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:18.550314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:18.566028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:18.569007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1a087c19-af31-4ef2-a83e-8480120725f1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.684814 Sep 09 01:49:18.569956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 77/164] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:17 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:18.584644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:18.594183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0e8fd66c-5321-4c88-9a99-0c7cb3b32627 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.716988 Sep 09 01:49:18.596442 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 88/165] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:17 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:18.862977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:18.864708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:18.875862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:18.878273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:18.878958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:18.879925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:18.880689 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:18.881504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.187517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:19.195270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-69862f83-51b1-4d96-b621-d968d1f2e8c0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.337528 Sep 09 01:49:19.195839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 78/166] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:18 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:19.369561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d", "tag": "bd3cd99c-b16b-4f0a-8889-0a455d3fb939"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:19.379546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:19.380020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:19.380434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.391499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] Creating event network-changed:bd3cd99c-b16b-4f0a-8889-0a455d3fb939 for instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d on hv-cinder-85221 Sep 09 01:49:19.396382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-536f03b6-321c-4633-b121-93f64ba37ecc req-eeba8f06-8481-4ebe-92c9-b79388fa19a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030243 Sep 09 01:49:19.397040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 89/167] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:19.591871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:19.592488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:19.598994 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:19.599486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:19.599935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.600610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:19.601133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:19.601762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.627132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:19.637437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:19.654889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:19.656411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:19.656848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.657567 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:19.658957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:19.659371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:19.770844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:19.773121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:19.784274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2cff51e1-7ce0-4428-b8b7-3837512da758 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.196155 Sep 09 01:49:19.785626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 79/168] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:19 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:19.934816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:19.945325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-104195a3-7257-481d-873e-9afa776b763b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.328322 Sep 09 01:49:19.945903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 90/169] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:19 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:20.214698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:20.229698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:20.230870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:20.241501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.242770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.243622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:20.244679 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.245508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.246136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:20.412383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:20.422627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-36f04f47-810f-4768-94a5-65ba8d981abf tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.208723 Sep 09 01:49:20.423571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 80/170] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:20 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:20.810829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:20.812349 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:20.820139 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.820922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.821751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:20.822766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.823393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.824009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:20.970594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:20.971079 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:20.990267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.993466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.994126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:20.995146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:20.996916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:20.998530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:21.097022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:21.108538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dec56851-f997-4cbd-b538-6922a9d070a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.303345 Sep 09 01:49:21.109168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 91/171] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:20 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:21.181792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:21.186913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:21.196912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5dfb77b2-0e53-42a5-bac0-938699979835 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.230522 Sep 09 01:49:21.219684 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 81/172] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:20 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:21.447515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:21.448461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:21.454818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:21.455201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:21.456077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:21.456882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:21.457860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:21.458302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:21.629316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:21.638403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-87489551-5fc4-40ce-be69-02b5d00e7935 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.195212 Sep 09 01:49:21.639278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 92/173] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:21 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:21.702965 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00901855-faa9-4125-875b-927658be9ccd", "name": "network-vif-plugged", "status": "completed", "tag": "83e9b084-f05c-44c4-9172-e61d551a8835"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:21.713196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:21.713672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:21.714119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:21.725942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] Creating event network-vif-plugged:83e9b084-f05c-44c4-9172-e61d551a8835 for instance 00901855-faa9-4125-875b-927658be9ccd on hv-cinder-85221 Sep 09 01:49:21.731352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-e5169be7-976a-4bb0-94a7-0f9e9e900787 req-296859b0-c8bf-4452-9739-abbc25de2805 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167606 Sep 09 01:49:21.732702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 82/174] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:49:22.139092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:22.139894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:22.150258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.150719 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.151399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.152150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.152873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.153348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.223493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:22.224732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:22.242139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.242533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.242971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.244931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.245459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.246286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.448848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:22.461760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-93e7efa5-6a6a-48b3-8c0b-bb735fab606c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.333228 Sep 09 01:49:22.464984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 93/175] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:22 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:22.554058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:22.562393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b50a0b35-8de7-4f31-a88c-a45f588a5e2c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.347190 Sep 09 01:49:22.563235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 83/176] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:22 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:22.665469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:22.666899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:22.678936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.679629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.683303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.684300 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:22.684835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:22.686120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:22.968372 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:22.979867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e28b937d-31c2-4030-bea0-7bfffbd81594 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.319955 Sep 09 01:49:22.981382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 94/177] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:22 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:23.493657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:23.494265 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:23.504940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:23.505479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:23.506239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:23.508026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:23.508701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:23.509307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:23.589280 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:23.590606 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:23.597009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:23.602384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:23.603084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:23.604136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:23.604940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:23.605602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:24.208434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:24.217700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e800c683-a250-4a42-a1a6-cf86bccec5fd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.731385 Sep 09 01:49:24.218881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 84/178] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:23 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:24.225653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:24.226503 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:24.233874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:24.234537 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:24.235116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:24.236004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:24.236456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:24.236876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:24.418718 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:24.428507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6bc18881-7d91-4f3b-a960-45f5dbf69563 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.843291 Sep 09 01:49:24.450741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 95/179] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:23 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:24.966762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:24.984178 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7bb82ec4-ff1f-4e62-93e0-f430eba324fd tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.763182 Sep 09 01:49:24.985033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 85/180] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:24 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:25.243609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:25.244301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:25.255630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:25.256129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:25.256561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:25.265426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:25.266126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:25.266431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:25.457724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:25.458388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:25.475489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=79 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:25.481486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:25.482092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:25.483098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:25.485797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:25.489533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:25.490594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:25.528069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:25.548476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1bf31b4c-2c8b-430f-b519-9071c7b4db9a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.309042 Sep 09 01:49:25.549077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 96/181] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:25 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:25.564945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc7b518-07bb-4875-9e60-f41f7b2c7f37", "name": "network-vif-plugged", "status": "completed", "tag": "11df9340-6e9d-409c-909e-a7dad07fffe3"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:25.591144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:25.591905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:25.595782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:25.618733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] Creating event network-vif-plugged:11df9340-6e9d-409c-909e-a7dad07fffe3 for instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 on hv-cinder-85221 Sep 09 01:49:25.641465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-a6ba79cc-a2be-4ad1-8b0d-835ecb11a498 req-8da7c929-60db-41cf-8e10-f1765b87cd90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085640 Sep 09 01:49:25.646530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 97/182] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:25.951477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:25.960799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-745950f6-bcfc-45d1-a4b0-2c8771685b2e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.507738 Sep 09 01:49:25.977199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 86/183] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:25 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:26.012468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:26.013701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:26.021845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:26.022951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:26.024314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:26.028406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:26.029309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:26.029843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:26.575987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:26.576793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:26.587737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:26.588375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:26.588900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:26.590837 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:26.591470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:26.593573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:27.022580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:27.031573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a39f5399-d5b3-48a3-818b-74bb1f1a43e3 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 1.023194 Sep 09 01:49:27.032183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 98/184] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:26 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:27.041914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:27.042510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:27.070974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:27.071476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:27.071912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:27.072617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:27.073089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:27.073527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:27.167496 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:27.176536 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cdd02c5a-2943-47d8-a370-1542a6cbad0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.604554 Sep 09 01:49:27.177138 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 87/185] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:26 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:27.627828 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:27.637861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b3bb99d8-6ed2-4550-b4a5-c8bd2808fe53 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.599642 Sep 09 01:49:27.646197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 99/186] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:27 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:27.662738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10c908e-1792-46e9-ae0a-6727f8bf4923", "name": "network-vif-plugged", "status": "completed", "tag": "11b14534-43ce-4d43-b397-4294269046b0"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:27.676746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:27.677639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:27.678359 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:27.694843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] Creating event network-vif-plugged:11b14534-43ce-4d43-b397-4294269046b0 for instance f10c908e-1792-46e9-ae0a-6727f8bf4923 on hv-cinder-85221 Sep 09 01:49:27.702867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-a1a60357-97f4-48a4-a406-c5bbde5c87bc req-aa950d5b-d2e0-4b5c-8b46-8e38a32272bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044204 Sep 09 01:49:27.704152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 88/187] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:28.054208 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:28.054807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:28.061609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.063520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.064985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.067060 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.069265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.069849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.202771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:28.203547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:28.221101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.224808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.226957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.227924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.228396 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.228828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.481142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:28.490227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e9144742-fa71-4ec3-8833-85b8fe3bf88b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1315 microversion: 2.1 time: 0.439706 Sep 09 01:49:28.493191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 100/188] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:28 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:28.662183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:28.663203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:28.689956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:28.696423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.696912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.698036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-49f61967-4abc-4727-b709-99681f0e6767 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1322 microversion: 2.1 time: 0.499685 Sep 09 01:49:28.698733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.699472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:28.700413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:28.701678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:28.719730 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 89/189] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:28 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:28.884924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:28.895369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d0d43a1a-5aec-4504-b364-d293aaf3b5e8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.237990 Sep 09 01:49:28.895912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 101/190] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:28 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:29.516636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:29.517370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:29.523999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:29.525257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:29.525672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:29.526370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:29.526889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:29.527576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:29.733555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:29.734354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:29.741955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:29.742848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:29.743884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:29.744912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:29.745594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:29.746322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.086637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:30.114311 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9521f209-9594-42bc-b87f-7efe1c6c1115 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1502 microversion: 2.1 time: 0.601299 Sep 09 01:49:30.115067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 90/191] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:29 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1502 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:30.134746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:30.153208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:30.186480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.187436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.189854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.192351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.193088 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.193786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.406096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:30.419391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e814a224-ce25-4595-ab8b-bb7ae95a2278 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1516 microversion: 2.1 time: 0.690021 Sep 09 01:49:30.420828 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 102/192] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:29 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1516 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:30.447696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:30.451227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:30.467329 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.467822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.468428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.469043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:30.469569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.470195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.470772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.481528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-80db679d-265e-42ed-a128-9793ed797540 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.355025 Sep 09 01:49:30.485921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 91/193] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:30 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:30.562485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lazy-loading 'flavor' on Instance uuid 00901855-faa9-4125-875b-927658be9ccd {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:49:30.731170 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c2c2cde6-90ba-43c8-b433-79a5140a334e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd/action" status: 200 len: 32 microversion: 2.1 time: 0.289926 Sep 09 01:49:30.732125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 103/194] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:49:30 2022] POST /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 01:49:30.742775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:30.744067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:30.751983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.752658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.753973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.754673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:30.755291 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:30.755815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:30.895155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:30.903820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-281970e7-2f17-4a28-a240-ba53950d3430 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.165964 Sep 09 01:49:30.904951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 92/195] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:30 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:31.505711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:31.506410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:31.513390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.514398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.514986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:31.515808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.516472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.517040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:31.710146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:31.716787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:31.730577 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-24055020-0c65-45c5-bcc2-45c4d1f8aa38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.229549 Sep 09 01:49:31.747966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 104/196] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:31 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:31.751145 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d3f5f5-75c6-4dbb-b7de-ffddf253525e"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:31.754148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:31.761687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.762423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.762964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:31.764559 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.765156 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.765789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:31.927321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:31.927937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:31.935866 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.936576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.937015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:31.937812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:31.938433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:31.938857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:32.145054 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:32.154420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-97e2d6c6-ad97-4155-8ed4-f190ccb99c09 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.231186 Sep 09 01:49:32.155358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 105/197] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:31 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:32.757149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:32.758856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:32.761528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=76 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:32.768297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:32.769272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:32.770058 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:32.771077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:32.771837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:32.772812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:32.960390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:32.968089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c12b2780-e7f2-4398-84eb-1f3909992a1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.216023 Sep 09 01:49:32.968655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 106/198] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:32 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:33.176873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:33.177534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:33.183463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:33.183946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:33.184403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:33.185109 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:33.185569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:33.185982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:33.322749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:33.330444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-34a0f0f5-5f86-4547-9e10-c0ae8f9b76a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.157451 Sep 09 01:49:33.331002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 107/199] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:33 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:33.991569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:33.992994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:34.000295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:34.001215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:34.001794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:34.002816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:34.004101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:34.004796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:34.174478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:34.182757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a344c5e7-324e-4c8d-a0a7-c5056df95c4e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.195612 Sep 09 01:49:34.183323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 108/200] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:33 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:34.354506 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:34.355937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:34.366140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:34.367824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:34.368453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:34.369384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:34.370016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:34.370829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:34.533931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:34.542049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c3b76e97-c6bb-48f9-b498-95649eb36b15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.191875 Sep 09 01:49:34.542641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 109/201] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:34 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:35.205621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:35.206859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:35.212773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:35.213295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:35.213720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:35.214427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:35.214872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:35.215282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:35.347539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:35.355215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5227f139-2e12-4a4b-b555-c81135cfd81b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.153547 Sep 09 01:49:35.356113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 110/202] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:35 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:35.564326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:35.564932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:35.572309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:35.572793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:35.573262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:35.573947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:35.574403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:35.574823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:35.713371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:35.720873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2ccf471b-f54a-4399-8682-65cb95473858 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.160299 Sep 09 01:49:35.721469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 111/203] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:35 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:36.380853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:36.382257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:36.390014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:36.390912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:36.391554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:36.392459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:36.393136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:36.394467 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:36.567306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:36.574927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9d9ae7fa-8839-4520-b3cf-3e97c57a5297 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.199739 Sep 09 01:49:36.589483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 112/204] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:36 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:36.745519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:36.746299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:36.753778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:36.754478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:36.754910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:36.755602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:36.756057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:36.756479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:36.912193 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:36.930908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f8a9f20d-0e25-4a1a-b953-ec62f88ceca8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.188999 Sep 09 01:49:36.931493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 113/205] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:36 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:37.598914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:37.599542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:37.605397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:37.605883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:37.606310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:37.607158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:37.607620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:37.608036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:37.778500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:37.787929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-672ba7de-cd94-439b-b919-c6b21f80f52e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.193541 Sep 09 01:49:37.789625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 114/206] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:37 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:37.957251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:37.958741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:37.966100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:37.966862 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:37.967398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:37.968418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:37.969303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:37.969861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:38.133273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:38.141926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-05d28040-eaac-4f31-9d22-88ce43ec130c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.190218 Sep 09 01:49:38.142626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 115/207] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:37 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:38.649392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d", "name": "network-vif-plugged", "status": "completed", "tag": "bd3cd99c-b16b-4f0a-8889-0a455d3fb939"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:38.671636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:38.676973 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:38.677457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:38.716019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] Creating event network-vif-plugged:bd3cd99c-b16b-4f0a-8889-0a455d3fb939 for instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d on hv-cinder-85221 Sep 09 01:49:38.733908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-852ec740-b93c-4942-b7ae-aca1874ffebc req-77ade2d3-780d-4d39-924b-8841fd35e91c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093733 Sep 09 01:49:38.738265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 116/208] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:38.813221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:38.813925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:38.827239 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:38.827814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:38.828394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:38.829152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:38.829615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:38.830037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:38.851794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e5dd31a1-3482-4600-97a9-5cad179530b1 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "POST /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.106645 Sep 09 01:49:38.858790 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 93/209] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:49:31 2022] POST /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37/os-volume_attachments => generated 194 bytes in 7114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:39.167192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:39.168241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:39.178889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:39.179914 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:39.180681 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:39.182619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:39.183126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:39.183509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:39.446271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:39.457021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cb256616-537f-42c4-8953-290e774ca2cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.647960 Sep 09 01:49:39.460567 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 117/210] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:38 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:39.592285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:39.601331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ac2258f5-30c2-479c-8b87-9b8ba9cbf5e4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.438668 Sep 09 01:49:39.603890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 94/211] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:39 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:40.484746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:40.487046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:40.493841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:40.494333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:40.494758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:40.495448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:40.495896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:40.496310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:40.628328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:40.629442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:40.636741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:40.637265 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:40.637700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:40.638400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:40.638846 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:40.639226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:40.639450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:40.647789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0a76462f-8802-4dbb-b8d2-43e9568ab28e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.167214 Sep 09 01:49:40.648453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 118/212] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:40 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:40.780100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:40.790339 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-228eb133-a2a5-4a05-966f-e08739b54ed0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.168863 Sep 09 01:49:40.791277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 95/213] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:40 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:41.671356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:41.671989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:41.678493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:41.678969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:41.679393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:41.680066 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:41.680509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:41.681141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:41.818538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:41.819810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:41.827569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:41.828303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:41.828934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:41.830001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:41.844414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:41.844414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:41.844658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:41.844658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-488a5161-5f03-4bdd-a75e-a4e954ff9da9 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.175478 Sep 09 01:49:41.844658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 119/214] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:41 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:41.974777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:41.983634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ae56187a-8017-48c4-bced-6406fe3f1ad4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.169357 Sep 09 01:49:41.984412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 96/215] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:41 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:42.866386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:42.867075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:42.874244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:42.874841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:42.875365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:42.876142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:42.876875 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:42.877388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:43.008087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:43.008830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:43.019240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:43.019803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:43.020293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:43.021074 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:43.021594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:43.022221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:43.028678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:43.037583 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a5cedd01-4068-42cf-add5-00138ce25f98 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.175489 Sep 09 01:49:43.038159 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 120/216] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:42 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:43.168028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:43.177409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0d02bd77-a59e-4b1c-a584-e9cdd5b27e0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.172938 Sep 09 01:49:43.178131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 97/217] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:43 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:44.059666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:44.060636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:44.067040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:44.067528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:44.067961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:44.068644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:44.069118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:44.069568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:44.201459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:44.203012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:44.203736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:44.212449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:44.213178 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:44.213748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:44.214801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-26beb42d-1e4c-4e92-b939-9f2c9eecfc0d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.158931 Sep 09 01:49:44.215078 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:44.215375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 121/218] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:44 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:44.229357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:44.229357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:44.276327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:44.569378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:44.577516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b6007dec-df5f-4a4e-a5e0-2124e6546f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.380290 Sep 09 01:49:44.578085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 98/219] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:44 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:45.247542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:45.248242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:45.254346 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:45.254723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:45.255375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:45.256212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:45.256679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:45.257121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:45.261561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:45.409815 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:45.417658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6f203fb8-39f8-4758-9c89-8a4890a3909b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1362 microversion: 2.1 time: 0.175206 Sep 09 01:49:45.433341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 122/220] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:45 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:45.610137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:45.611501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:45.618377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:45.619075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:45.619597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:45.620258 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:45.620713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:45.621188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:45.781339 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:45.790009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-736c9130-2350-4252-a9d5-7d11123053df tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.183567 Sep 09 01:49:45.790578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 99/221] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:45 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:46.439599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:46.440526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:46.448919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.449440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.450038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:46.450721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.451164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.451578 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:46.590186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:46.599646 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b52ee0a6-f1d6-4ec4-bf63-2204ea29302f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1548 microversion: 2.1 time: 0.163773 Sep 09 01:49:46.600218 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 123/222] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:46 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:46.623140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:46.624422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:46.631756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.632927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.633397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:46.634341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.634795 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.635491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:46.730301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ca63828b-39bc-4a13-8b89-022b00bccf9f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111881 Sep 09 01:49:46.730879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 100/223] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:49:46 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:49:46.818565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:46.819616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:46.831595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.832323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.832940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:46.834032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:46.835274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:46.835887 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:47.330164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:47.340122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f276dfa3-ae1b-49c2-bc32-3755e40234de tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.530042 Sep 09 01:49:47.340838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 124/224] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:46 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:48.253439 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d", "tag": "bd3cd99c-b16b-4f0a-8889-0a455d3fb939"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:48.265788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:48.266588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:48.267225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:48.284274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] Creating event network-changed:bd3cd99c-b16b-4f0a-8889-0a455d3fb939 for instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d on hv-cinder-85221 Sep 09 01:49:48.291551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-92442901-2d45-46a6-aa2d-45a9709ffce5 req-0db8623b-3f80-4145-a815-6c2558d3fe9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043092 Sep 09 01:49:48.292449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 101/225] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:49:48.365176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:48.365851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:48.384023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:48.384546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:48.385367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:48.386746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:48.387396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:48.387892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:48.636099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:48.645024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-56f31285-7941-4225-8dc4-68e88d7aaae2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.283751 Sep 09 01:49:48.648124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 125/226] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:48 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:49.673643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:49.676175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:49.684514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:49.685201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:49.685730 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:49.686603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:49.687163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:49.687892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:50.020824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:50.030399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ca316a87-f0c9-4efd-9a0c-ff878da3ec59 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.362097 Sep 09 01:49:50.030975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 102/227] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:49 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:51.055127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:51.056526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:51.063952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:51.078589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:51.079600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:51.081081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:51.087304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:51.087923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:51.256016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:51.263999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-170d5e1e-57a4-45ad-a270-e8bc1d5ae184 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.212775 Sep 09 01:49:51.264566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 126/228] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:51 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:52.293701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:52.294586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:52.302873 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:52.303440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:52.303946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:52.304895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:52.305381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:52.305803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:52.454062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:52.466055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-479f26a2-a7ad-4bd7-9a0e-b4a6d86dfb79 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.176699 Sep 09 01:49:52.466885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 103/229] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:52 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:53.499212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:53.499881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:53.519213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:53.523248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:53.523873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:53.525480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:53.526949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:53.527383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:53.802771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:53.815179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3b17bffb-8162-4697-a966-ab81dcc80aa7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.325170 Sep 09 01:49:53.817617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 127/230] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:53 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:54.840682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:54.841409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:54.847882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:54.848435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:54.848988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:54.849834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:54.850279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:54.850697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:54.989495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:55.001584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-84e17e1d-3400-4438-8bf7-17d731af1cb0 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.162929 Sep 09 01:49:55.004680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 104/231] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:54 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:55.513544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:55.514104 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:55.520356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:55.520832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:55.521285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:55.521959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:55.522403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:55.522817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:55.547486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:49:55.641108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-83998626-3b5f-47b1-a9df-aac2e907029d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 204 len: 0 microversion: 2.1 time: 0.131637 Sep 09 01:49:55.641717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 128/232] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:49:55 2022] DELETE /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:49:55.650296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:55.650906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:55.652849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=38 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:49:55.657990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:55.659001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:55.659450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:55.660137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:55.660593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:55.661017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:55.818562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:55.828404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f21de663-4eec-446e-8ec2-7462ec040649 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1554 microversion: 2.1 time: 0.182016 Sep 09 01:49:55.829175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 105/233] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:55 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:56.031684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:56.032383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:56.038332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:56.038707 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:56.039138 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:56.039820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:56.040275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:56.040693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:56.177956 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:56.185504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2ac4ef09-541c-4b03-8f67-c49d905920ef tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.157921 Sep 09 01:49:56.186056 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 129/234] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:56 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:56.661556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1353269544", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "networks": [{"uuid": "42295414-a394-45f7-a204-20fad43f09ee"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:56.852549 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:56.853304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:56.859463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:56.859942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:56.860530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:56.861960 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:56.862561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:56.863143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:57.077933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:57.090459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d8656e7f-e107-45ad-8e7f-14f50d30a95d tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1554 microversion: 2.1 time: 0.241601 Sep 09 01:49:57.105092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 130/235] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:56 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:57.208869 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:57.209432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:57.225324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:57.226204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:57.227160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:57.228686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:57.229497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:57.230346 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:57.396626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:57.413468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a55fd8ea-a558-48d8-a3d4-a5e23c9fb9d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.208891 Sep 09 01:49:57.418355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 131/236] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:57 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:58.118653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:58.119449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:58.126605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:58.127594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:58.128091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:58.128855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:58.129536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:58.130033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:58.328162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:58.339657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d3477e20-ede1-4e26-9abc-d0ceba7b0863 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1554 microversion: 2.1 time: 0.224833 Sep 09 01:49:58.340244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 132/237] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:58 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:58.445819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:58.446634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:58.452635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:58.453294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:58.453731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:58.454416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:58.455072 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:58.455867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:58.736635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:58.745605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bc9c7324-59f2-4f39-bfa1-5027fe00803d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.305169 Sep 09 01:49:58.758176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 133/238] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:58 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:49:59.320302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc7b518-07bb-4875-9e60-f41f7b2c7f37", "name": "network-vif-deleted", "tag": "11df9340-6e9d-409c-909e-a7dad07fffe3"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:49:59.341134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:59.341931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:59.342877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:59.364327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] Creating event network-vif-deleted:11df9340-6e9d-409c-909e-a7dad07fffe3 for instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 on hv-cinder-85221 Sep 09 01:49:59.370681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-e3fcf4a8-b97e-4fed-9866-5133de17bac9 req-8de4ed13-0e67-42dd-9f6e-47ef62bb7366 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054482 Sep 09 01:49:59.371278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 134/239] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:49:59.378087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:59.378659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:59.427017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:59.431392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:59.432645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:59.438318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:59.438876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:59.442475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:59.525391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:59.537823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9a112f8e-477a-4dfe-aa45-64bab1d86ae4 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1346 microversion: 2.1 time: 0.164668 Sep 09 01:49:59.538410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 135/240] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:59 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:49:59.770924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:49:59.771495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:49:59.777396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:59.777883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:59.778314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:59.779022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:49:59.779479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:49:59.779897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:49:59.924362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:49:59.932925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-04cfefb7-8c7c-41aa-b0a3-75bcde8cef30 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.166294 Sep 09 01:49:59.933832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 136/241] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:49:59 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:00.560898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:00.564450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:00.568445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:00.568915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:00.569392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:00.570326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:00.571501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:00.571931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:00.612277 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:00.612945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:00.613411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:00.613972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lazy-loading 'fault' on Instance uuid 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:50:00.621309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:00.675348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d415854b71b4366a2f8d11e64271ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940a7e4459874ae3b54c5db3ec096b8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:00.683898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fca6673c-cda9-4526-9f2b-562d4feb34e8 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 200 len: 1351 microversion: 2.1 time: 0.128042 Sep 09 01:50:00.695085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 137/242] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:00 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:00.955612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:00.956509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:00.963980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:00.964667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:00.965280 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:00.966116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:00.967035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:00.967601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:01.122345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:01.132365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3dc57627-dd92-4d79-970b-9458623a289e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.180626 Sep 09 01:50:01.132930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 138/243] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:00 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:01.707044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:01.707753 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:01.713550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:01.714241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:01.714664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:01.715344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:01.715786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:01.716194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:01.729975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] HTTP exception thrown: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Request method failure captured: Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 HTTP/1.1 Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptwXHUnWAOCp7PnXr4BHZqfgjid_uWaXhho1MKiF00CcK73w3-FNuA4uf4CsGwoeUBHyY2i7Lt9YmHC10onD4J7Iz7Btb1WCFBbFTaNygXB2-05hBSgh9zRH3IdJi8zF3y19UMwT_BAaQtoVtTnB1Jxap0vpb9v7NfLXbbTKTg_jAs Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:50:01.734636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_940a7e4459874ae3b54c5db3ec096b8d", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 6d415854b71b4366a2f8d11e64271ccc Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.736081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '1bc7b518-07bb-4875-9e60-f41f7b2c7f37'} Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:50:01.737169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.738776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.740306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Returning 404 to user: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:50:01.740306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d24ce45b-2e59-4fd9-b0e4-a41c0668d0b0 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 404 len: 111 microversion: 2.1 time: 0.033265 Sep 09 01:50:01.740306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 139/244] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:01 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:50:01.863436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:01.865673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:01.871516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:01.872322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:01.872813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:01.873603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:01.874053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:01.874464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:01.887596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] HTTP exception thrown: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Request method failure captured: Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37/os-volume_attachments HTTP/1.1 Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptwXHUnWAOCp7PnXr4BHZqfgjid_uWaXhho1MKiF00CcK73w3-FNuA4uf4CsGwoeUBHyY2i7Lt9YmHC10onD4J7Iz7Btb1WCFBbFTaNygXB2-05hBSgh9zRH3IdJi8zF3y19UMwT_BAaQtoVtTnB1Jxap0vpb9v7NfLXbbTKTg_jAs Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:50:01.889418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_940a7e4459874ae3b54c5db3ec096b8d", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 6d415854b71b4366a2f8d11e64271ccc Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.890686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'server_id': '1bc7b518-07bb-4875-9e60-f41f7b2c7f37'} Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:50:01.891323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:01.893091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:01.894133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Returning 404 to user: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:50:01.894133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0e086182-22d0-48e1-98fe-d6144389d65e tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031399 Sep 09 01:50:01.894133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 140/245] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:50:01 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 01:50:02.154603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:02.155264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:02.161103 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:02.161758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:02.162183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:02.163022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:02.163621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:02.164253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:02.364906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:02.375307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-99fb720e-56bc-44ad-8984-1ce81efdb64b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.224352 Sep 09 01:50:02.379423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 141/246] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:02 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:03.113424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:03.113994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:03.115803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:03.121051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.121559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.122231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.122906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.123350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.123760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.137642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] HTTP exception thrown: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Request method failure captured: Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 HTTP/1.1 Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptwXHUnWAOCp7PnXr4BHZqfgjid_uWaXhho1MKiF00CcK73w3-FNuA4uf4CsGwoeUBHyY2i7Lt9YmHC10onD4J7Iz7Btb1WCFBbFTaNygXB2-05hBSgh9zRH3IdJi8zF3y19UMwT_BAaQtoVtTnB1Jxap0vpb9v7NfLXbbTKTg_jAs Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:50:03.139186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_940a7e4459874ae3b54c5db3ec096b8d", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 6d415854b71b4366a2f8d11e64271ccc Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.140571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '1bc7b518-07bb-4875-9e60-f41f7b2c7f37'} Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:50:03.141370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.143122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.144801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Returning 404 to user: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:50:03.144801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2fe39a73-d09d-4fea-a469-e868409cc95b tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 404 len: 111 microversion: 2.1 time: 0.031227 Sep 09 01:50:03.144801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 142/247] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:50:03 2022] DELETE /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:50:03.149809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:03.150514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] [instance: 1bc7b518-07bb-4875-9e60-f41f7b2c7f37] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:03.156264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.156745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.157209 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.158560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.159021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.159443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.172688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] HTTP exception thrown: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Request method failure captured: Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 HTTP/1.1 Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptwXHUnWAOCp7PnXr4BHZqfgjid_uWaXhho1MKiF00CcK73w3-FNuA4uf4CsGwoeUBHyY2i7Lt9YmHC10onD4J7Iz7Btb1WCFBbFTaNygXB2-05hBSgh9zRH3IdJi8zF3y19UMwT_BAaQtoVtTnB1Jxap0vpb9v7NfLXbbTKTg_jAs Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:50:03.174281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/940a7e4459874ae3b54c5db3ec096b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_940a7e4459874ae3b54c5db3ec096b8d", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 940a7e4459874ae3b54c5db3ec096b8d Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1992838306 Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 6d415854b71b4366a2f8d11e64271ccc Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-DeleteServersTestJSON-1992838306-project Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.175745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '1bc7b518-07bb-4875-9e60-f41f7b2c7f37'} Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:50:03.177703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. Sep 09 01:50:03.179211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:50:03.180345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] Returning 404 to user: Instance 1bc7b518-07bb-4875-9e60-f41f7b2c7f37 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:50:03.180345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-246113e3-71d1-4042-88db-7ffcf728a839 tempest-DeleteServersTestJSON-1992838306 tempest-DeleteServersTestJSON-1992838306-project] 10.222.0.15 "GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37" status: 404 len: 111 microversion: 2.1 time: 0.029575 Sep 09 01:50:03.180345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 143/248] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:03 2022] GET /compute/v2.1/servers/1bc7b518-07bb-4875-9e60-f41f7b2c7f37 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:50:03.413990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:03.414845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:03.420893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.421595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.422077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.422997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:03.423494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:03.423912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:03.701341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:03.710504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d7923e36-9e01-4dcb-a10c-4a46d9194b3d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.300264 Sep 09 01:50:03.711255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 144/249] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:03 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:04.734096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:04.734776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:04.740658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:04.741243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:04.741734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:04.742466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:04.742976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:04.743452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:04.969196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:04.977979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-50d30c6e-31d6-49f8-8ff4-142b25470b2c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.247729 Sep 09 01:50:04.978845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 145/250] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:04 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:05.019803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-704168498", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:05.824333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=38 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:06.685658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:08.465561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] validate_networks() for [('42295414-a394-45f7-a204-20fad43f09ee', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:50:08.466094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] validate_networks() for None {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:50:09.078043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:50:09.078611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:50:09.080272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:50:09.080685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:50:09.081131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:50:09.099965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.100680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.101286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.102182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.102780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.103879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.136905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Getting quotas for project b88c8a0deaaa4aba915ef5e2c32a427b. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:50:09.148692 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Getting quotas for user 56ff8a77507c43fba14f0d997cc912ec and project b88c8a0deaaa4aba915ef5e2c32a427b. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:50:09.160880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:50:09.163235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:50:09.233530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cf66d41b-3fe3-4608-8a54-597223b9abed tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.216627 Sep 09 01:50:09.234749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 146/251] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:50:09.265009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:50:09.265826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:50:09.266451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:50:09.267102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:50:09.267665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:50:09.275145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:09.281932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:09.283984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.284939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.285575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.287127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.287811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.288408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.294958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.295487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.295923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.307255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:09.309423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:09.319378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:09.341100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Getting quotas for project f4e0c857a31147f8afe25e68cc3e9f24. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:50:09.351227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Getting quotas for user 6f366d6ae3b4404f9fa4343913f67998 and project f4e0c857a31147f8afe25e68cc3e9f24. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:50:09.366338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:50:09.368704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:50:09.471599 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-85584248-e650-4a08-a603-d7224bd4561b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.812184 Sep 09 01:50:09.474690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 106/252] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 12819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:50:09.485509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-52228d7a-36f0-48fe-b1d2-e3ba6b04da46 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:09.486730 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-52228d7a-36f0-48fe-b1d2-e3ba6b04da46 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:09.583082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-52228d7a-36f0-48fe-b1d2-e3ba6b04da46 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:09.590734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-52228d7a-36f0-48fe-b1d2-e3ba6b04da46 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1214 microversion: 2.1 time: 0.114910 Sep 09 01:50:09.591387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 107/253] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:09 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:09.624002 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9d8f5212-7f07-4bff-9572-054328888e0b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:09.625051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9d8f5212-7f07-4bff-9572-054328888e0b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:09.647939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:09.661724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-97937f45-18f6-4b96-ba23-b4e89f7bb7e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.415394 Sep 09 01:50:09.678516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 147/254] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:09 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:09.736594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9d8f5212-7f07-4bff-9572-054328888e0b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:09.762959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9d8f5212-7f07-4bff-9572-054328888e0b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1214 microversion: 2.1 time: 0.152813 Sep 09 01:50:09.766085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 108/255] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:09 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:10.615359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:10.616327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:10.623548 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.624350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.625002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.626129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.627525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.628216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.690459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:10.691514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:10.702929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.703516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.704531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.705576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.706316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.707732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.730629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:10.741433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c27645c6-144c-49e0-8313-27e6bde174a5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1266 microversion: 2.1 time: 0.129764 Sep 09 01:50:10.742484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 148/256] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:10 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:10.791723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:10.792581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:10.805231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.805735 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.806171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.820059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:10.820618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:10.821055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:10.979561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:10.988842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dfc92cf9-411f-4f76-8199-c0cbec24839a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1210 microversion: 2.1 time: 0.202227 Sep 09 01:50:10.989681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 149/257] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:10 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:11.022596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:11.031348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-45d11717-2a3c-45e3-a225-facc3f35f478 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.345325 Sep 09 01:50:11.032822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 109/258] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:10 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:11.767554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:11.768609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:11.776852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:11.777793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:11.778083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:11.778798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:11.779220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:11.779627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:11.884385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:11.925501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4719e303-e4de-4e14-a0c6-8911d4bcca4d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1272 microversion: 2.1 time: 0.161130 Sep 09 01:50:11.926579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 150/259] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:11 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:12.013551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:12.014168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:12.023194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.030839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.031291 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:12.032033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.033050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.034977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:12.054936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:12.055865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:12.064499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.067524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.069994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:12.070997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.071675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.078986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:12.272738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:12.281167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2e8b7652-89fe-45f9-b00a-47dcccd198b9 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1266 microversion: 2.1 time: 0.271446 Sep 09 01:50:12.281957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 110/260] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:12 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:12.420698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:12.435665 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-40f7f7a6-fd2f-4ed9-8f4f-0f75ad40e0b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.385111 Sep 09 01:50:12.450248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 151/261] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:12 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:12.953428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:12.954718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:12.967026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.970340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.970790 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:12.971522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:12.971986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:12.975666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:13.308446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:13.309668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:13.320595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:13.322151 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:13.323773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:13.325137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:13.327384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:13.328566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:13.446255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:13.462076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9733b259-64f9-421b-8f27-3e5b48f050be tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1272 microversion: 2.1 time: 0.158837 Sep 09 01:50:13.462687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 152/262] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:13 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:13.470888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:13.471737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:13.481253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:13.482102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:13.483645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:13.499700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:13.501576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:13.504246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:13.562551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:13.577120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-36392dcf-03c5-4e5a-81ee-a4db1719dc20 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.624158 Sep 09 01:50:13.579798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 111/263] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:12 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:14.301853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:14.324343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-377407cd-8c01-4f85-bf90-54989657c24c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.856028 Sep 09 01:50:14.333204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 153/264] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:13 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:14.494243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:14.495209 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:14.507007 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:14.507847 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:14.509610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:14.510748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:14.511371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:14.511979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:14.518226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4e7fe050-76fa-443d-9e5e-9c00e97eff00 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: .version_select at 0x7f87d88353a0>, body: {"keypair": {"name": "tempest-keypair-1271149871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKckDqLLg37RwLL8GkXx/UjC25XF+xk0hilu9WVMEc7EWnVy5fF/BTyYGzFDf1mzyX887SLza9+uvpBKGrCuNhcn2vpzoGvH/PY1RaFP2vur+Ao/m/yPslCk/ZFzxy8mA=="}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:14.535142 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-4e7fe050-76fa-443d-9e5e-9c00e97eff00 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:50:14.540261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-4e7fe050-76fa-443d-9e5e-9c00e97eff00 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:50:14.574557 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4e7fe050-76fa-443d-9e5e-9c00e97eff00 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229073 Sep 09 01:50:14.575888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 112/265] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:50:14.607704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:14.608353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:14.618386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:14.619151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:14.619954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:14.621219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:14.622290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:14.622925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:14.871503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:14.879988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6073c9eb-14a8-4796-ab88-c64c977783c3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.389636 Sep 09 01:50:14.880764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 154/266] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:14 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:15.042781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:15.057320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-95d9acad-0c63-49c3-8304-dd029bb6b02f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.457493 Sep 09 01:50:15.058057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 113/267] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:14 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:15.353107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:15.354689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:15.365548 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:15.366409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:15.369252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:15.370209 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:15.370871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:15.371616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:15.383480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230ed659-38d5-4417-ba30-7362f6b20671", "tag": "abf0e91b-cb4a-4c3c-8bc8-600df9410829"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:15.413170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:15.418228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:15.418926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:15.448794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] Creating event network-changed:abf0e91b-cb4a-4c3c-8bc8-600df9410829 for instance 230ed659-38d5-4417-ba30-7362f6b20671 on hv-cinder-85221 Sep 09 01:50:15.458568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-661571f7-abe2-4f9a-ab87-b9c3109c1a1d req-9a21773b-15b6-4bfa-9f47-14c61bf50567 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079069 Sep 09 01:50:15.459505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 114/268] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:50:15.846493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:15.855441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-694d37a1-be45-4356-9a2f-cb950b8b1d75 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.507031 Sep 09 01:50:15.869090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 155/269] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:15 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:15.905089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:15.905883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:15.926834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:15.927333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:15.927765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:15.928792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:15.929300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:15.929598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:16.084594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:16.085708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:16.095506 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:16.097907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:16.098513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:16.099397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:16.099838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:16.100415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:16.342716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:16.352882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f7aff081-1e08-4ac0-a164-f3829c81bb7f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.452274 Sep 09 01:50:16.361119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 115/270] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:15 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:16.482792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:16.495742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a60526ae-d41b-447d-ab77-158f281d4f51 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.415065 Sep 09 01:50:16.514046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 156/271] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:16 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:16.880731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:16.881663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:16.897365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:16.898117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:16.898801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:16.899758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:16.900419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:16.901048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.099541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-572583992", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3840bd6e-907e-4191-be2d-5f3b8f05d0c8"}], "security_groups": [{"name": "tempest-securitygroup--182928700"}], "key_name": "tempest-keypair-1271149871", "user_data": "}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:17.206455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:17.216067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7cbe6d92-7308-4d3d-91c4-cbc15b5014d5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.339707 Sep 09 01:50:17.217277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 116/272] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:16 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:17.321319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] validate_networks() for [('3840bd6e-907e-4191-be2d-5f3b8f05d0c8', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:50:17.380653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:17.381313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:17.393551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:17.394048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:17.394488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.395185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:17.399807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:17.400264 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.656477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:17.672741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a01f4672-f9a8-4dd1-a80a-aa28b4a4bfc3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.298848 Sep 09 01:50:17.674003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 117/273] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:17 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:17.679863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4", "tag": "99b8467e-7d03-4509-8d63-3738f12052a5"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:17.694287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:17.695224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:17.695835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.715439 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] Creating event network-changed:99b8467e-7d03-4509-8d63-3738f12052a5 for instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 on hv-cinder-85221 Sep 09 01:50:17.723103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-723fdea8-93ae-44ad-978b-3d810b877734 req-a0745671-cb85-4f71-95f8-05fb6d5ca17f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047344 Sep 09 01:50:17.723949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 118/274] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:50:17.732570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:17.733488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:17.741550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:17.742546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:17.743136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.744552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:17.745237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:17.745814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:17.945417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:17.955598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7d8d2cb3-7ab4-4930-9012-ce59d6a4836a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.230285 Sep 09 01:50:17.957139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 119/275] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:17 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:18.054458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:50:18.056052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:50:18.056675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:50:18.057253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:50:18.060485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:50:18.069858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.070554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.070980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.071687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.072132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.072542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.090543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:50:18.094340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:50:18.105678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:50:18.107843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:50:18.160308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-23476035-000d-4d5b-be4f-1739b8d3b209 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.065088 Sep 09 01:50:18.161019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 157/276] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:50:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 01:50:18.174512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4eadaea4-b871-4733-98d6-81f2f0586312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:18.175434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4eadaea4-b871-4733-98d6-81f2f0586312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:18.240198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:18.242835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4eadaea4-b871-4733-98d6-81f2f0586312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:18.243544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:18.250140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4eadaea4-b871-4733-98d6-81f2f0586312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1241 microversion: 2.1 time: 0.080675 Sep 09 01:50:18.252217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 120/277] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:18 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:18.252908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.253992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.254687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.255849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.256653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.257317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.279612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:18.460451 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:18.473334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-732e6bdd-50dd-4879-8ba7-e9e6a6c428c6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.235548 Sep 09 01:50:18.474388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 158/278] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:18 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:18.709889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:18.710651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:18.726521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.727120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.727665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.732504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.733394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.734209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.903990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:18.913283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-03a18b6a-1e0c-47e5-a589-0d14c89c9d94 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.214734 Sep 09 01:50:18.913881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 121/279] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:18 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:18.979831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:18.980533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:18.986985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.987476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.988171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:18.988951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:18.989461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:18.989883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.145262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:19.158841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f9bca358-a397-488b-892d-ed88ba1cf8a2 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.183883 Sep 09 01:50:19.162981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 159/280] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:18 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:19.275629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:19.276224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:19.294100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.294788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.295304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.296006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.296455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.296879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.314425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:19.372939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:19.383852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e864c0b6-f48b-4c4d-9482-fb79253f1ed2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1245 microversion: 2.1 time: 0.111929 Sep 09 01:50:19.384437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 122/281] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:19 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:19.496993 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:19.497714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:19.504223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.504703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.505451 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.506138 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.506619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.507031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.647624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:19.655388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ea963091-aa40-4ff9-a39b-f8d0571b4f25 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.162400 Sep 09 01:50:19.655976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 160/282] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:19 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:19.936970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:19.938069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:19.955639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.963315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.964076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:19.964861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:19.965334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:19.965758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.106667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:20.114279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d7b81908-2130-4be2-addb-471a7f80d0a7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.182050 Sep 09 01:50:20.114872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 123/283] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:19 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:20.182449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:20.183086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:20.189441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.189923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.190357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.191038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.191493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.191916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.321702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:20.329602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0eaa004b-aed1-4939-b7c1-15fca1c7f014 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.150988 Sep 09 01:50:20.330171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 161/284] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:20 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:20.407064 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:20.407748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:20.413525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.414015 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.414446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.415130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.415603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.416025 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.477502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:20.486393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b82b42aa-0658-4de2-b197-821f8a7efaa9 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1245 microversion: 2.1 time: 0.083140 Sep 09 01:50:20.487047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 124/285] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:20 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:20.679069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:20.679706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:20.685605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.686083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.686513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.687185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:20.687634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:20.688049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:20.818990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:20.826647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c0ba1458-5d07-452a-8438-ba597ea44d4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.151376 Sep 09 01:50:20.827205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 162/286] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:20 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:21.138323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:21.139411 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:21.146603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.147405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.147929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.148721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.149418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.149943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.278622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:21.286757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-11375018-b07e-4d60-8f53-ab05eaba7260 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.152899 Sep 09 01:50:21.287319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 125/287] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:21 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:21.351750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:21.352347 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:21.358361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.358835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.359254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.359919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.360362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.360773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.488768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:21.496321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cfafa5f8-b6fb-4a06-b5ba-6fe3e4dab9fc tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.148426 Sep 09 01:50:21.497153 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 163/288] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:21 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:21.509461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:21.512373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:21.519016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.519613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.520141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.520907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.521452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.521942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.583341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:21.591001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1b7d8724-d03b-4240-aff8-35f5ddb5c319 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1245 microversion: 2.1 time: 0.085389 Sep 09 01:50:21.591564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 126/289] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:21 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:21.848758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:21.849513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:21.855366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.855828 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.856250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:21.856919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:21.857460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:21.857871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.228021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:22.236914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-09fa2347-a1c3-47d5-85d3-1792a715125f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.391757 Sep 09 01:50:22.237597 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 164/290] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:21 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:22.309199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:22.309802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:22.316865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.317397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.317900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.318643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.319297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.319807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.450011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:22.458021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-55bae13b-38d4-48bc-bacf-9637b8ddcbce tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.152822 Sep 09 01:50:22.458586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 127/291] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:22 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:22.520086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:22.521678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:22.531372 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.532896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.533573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.534591 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.535441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.536065 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.614194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:22.614855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:22.622151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.623170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.627253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.636131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:22.636430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:22.637047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:22.672378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:22.857082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:22.872457 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-75182b50-86c1-42e7-9efd-f08024133f53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1245 microversion: 2.1 time: 0.262192 Sep 09 01:50:22.891033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 128/292] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:22 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1245 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:22.982399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:22.990046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3d2c16ad-a5b4-439d-b388-ef66710211d1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.474928 Sep 09 01:50:22.990623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 165/293] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:22 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:23.263842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:23.264451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:23.270395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.270884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.271318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.272162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.272611 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.273042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.407296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:23.414894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-90817482-6678-4d09-98b5-1565d50d8c0c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.154959 Sep 09 01:50:23.415454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 129/294] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:23 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:23.481337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:23.481877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:23.488243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.488720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.489180 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.489859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.490318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.490738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.615780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:23.623570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c34b2855-22df-415b-926e-2e4d0df383b6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.146177 Sep 09 01:50:23.624219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 166/295] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:23 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:23.895859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:23.896461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:23.902445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.902920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.903349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.904313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:23.904499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:23.904878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:23.968344 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:23.976576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a75246f4-cc69-4a1d-ab95-958e16a6c95d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.084602 Sep 09 01:50:23.977171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 130/296] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:23 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:24.013141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:24.013783 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:24.020262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.020755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.021224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.021903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.022356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.022776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.151099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:24.159571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-06e12f96-2930-489f-a2e7-86dd9d1a76ee tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.150251 Sep 09 01:50:24.160133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 167/297] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:24 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:24.438656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:24.439232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:24.445606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.446095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.446559 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.447241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.447694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.448117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.573494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:24.581846 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fd9fd7d0-18dc-43bc-8358-cad65a772bd9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.147564 Sep 09 01:50:24.582402 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 131/298] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:24 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:24.646526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:24.647134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:24.653016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.653527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.653956 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.654638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:24.655091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:24.655509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:24.785318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:24.792781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c185f1bb-ba2e-4219-8358-5fedc4f4ae2c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.150046 Sep 09 01:50:24.793383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 168/299] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:24 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:24.999682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:25.000286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:25.006802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.007276 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.007704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.008375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.008820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.009269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.068972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:25.076698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-62c45012-5216-45de-bf53-e080c6650fb3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.081098 Sep 09 01:50:25.077300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 132/300] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:24 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:25.181837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:25.182446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:25.188352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.188836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.189307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.189991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.190441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.190893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.381790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:25.389893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-90914a5a-af90-4737-a148-a5244dd15095 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.211891 Sep 09 01:50:25.390737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 169/301] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:25 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:25.603760 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:25.604363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:25.610723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.611207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.611639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.612327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.612783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.613233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.741764 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:25.749563 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5cc6ede8-cfc3-48f1-8cd8-61f85e37153f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.149668 Sep 09 01:50:25.750137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 133/302] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:25 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:25.815525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:25.816136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:25.822049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.822530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.822961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.823639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:25.824088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:25.824508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:25.956313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:25.964294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4fede55-6025-4b5a-8cfa-623c1c2e5fa2 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.152499 Sep 09 01:50:25.964880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 170/303] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:25 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:26.099087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:26.099693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:26.105623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.106100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.106523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.107197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.107643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.108056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.167615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:26.175044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-92fd1a17-f3a2-4ab4-a769-e72e43a30e08 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.079757 Sep 09 01:50:26.175598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 134/304] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:26 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:26.412279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:26.413133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:26.419439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.419908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.420333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.421008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.421660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.422082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.556316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:26.564600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a71628ad-ae28-40ca-a2af-dc615ac72a4c tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.156313 Sep 09 01:50:26.565183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 171/305] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:26 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:26.773212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:26.773761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:26.780040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.780518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.780944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.781662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.782109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.782523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.910204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:26.917852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-38c50bc8-396c-4664-921c-8197803e430c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.148552 Sep 09 01:50:26.918425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 135/306] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:26 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:26.987078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:26.987696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:26.994014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.994490 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.994917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:26.995596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:26.996045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:26.996459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.128909 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:27.136439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4e5896a6-30c8-411f-a1a9-c1624d390b1a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.153672 Sep 09 01:50:27.136995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 172/307] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:26 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:27.197828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:27.198424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:27.204355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.204829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.205292 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.205966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.206419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.206834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.267742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:27.275289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-804327c9-5947-47ba-a5f6-656db8382b48 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.081326 Sep 09 01:50:27.275860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 136/308] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:27 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:27.586900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:27.587650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:27.595130 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.595242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.595626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.596485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.596931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.597634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.753474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:27.761029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ca2e9276-a6e5-434a-83cd-e5f7adde6869 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.177969 Sep 09 01:50:27.761615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 173/309] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:27 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:27.940091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:27.940719 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:27.947083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.947570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.948003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:27.948693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:27.949179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:27.949606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.077176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:28.085337 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8388af59-2a2a-4a63-a05e-995d7dbc7be6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.149485 Sep 09 01:50:28.085907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 137/310] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:27 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:28.159156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:28.159757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:28.161739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=4 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:28.162394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=12 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:28.168173 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.168665 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.169092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.169830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.170339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.170757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.298525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:28.299172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:28.300952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=16 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:28.301523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:28.305384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:28.306326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.306898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.307433 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.308115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.308565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.308980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.310881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-de37f429-2759-40e1-81b3-18fe2b4aa078 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.155616 Sep 09 01:50:28.311451 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 174/311] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:28 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:28.371872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:28.379811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8550e66b-0cbf-4223-baed-49666ac4231d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.085086 Sep 09 01:50:28.380371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 138/312] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:28 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:28.785045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:28.785619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:28.791326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.791802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.792227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.792893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:28.793364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:28.793777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:28.918839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:28.926755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-da0937cb-6a56-4ab9-88c1-e0baf3177c15 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.146380 Sep 09 01:50:28.927501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 175/313] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:28 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:29.108475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:29.109114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:29.116096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.116588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.117020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.117736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.118179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.118597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.247082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:29.254564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-58396786-3775-4a8e-b92a-0867922d98f8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.149970 Sep 09 01:50:29.255114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 139/314] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:29 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:29.333846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:29.334450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:29.340201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.340687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.341120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.341799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.342245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.342652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.403069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:29.403688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:29.410497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.411057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.411562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.412322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.412849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.413375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.489460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:29.493771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:29.497270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2bfc4cfd-591d-4204-99a3-b8ac82f353ed tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.097895 Sep 09 01:50:29.497854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 140/315] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:29 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:29.501771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cba279a7-6f3d-4d6a-8161-f5387574d929 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.171693 Sep 09 01:50:29.502332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 176/316] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:29 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:29.949737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:29.950289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:29.953183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:29.957839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.958325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.958757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:29.959438 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:29.959895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:29.960317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.090537 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:30.098566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-924fc5ac-4d9b-4d93-af82-8c3b22d33ce7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.152697 Sep 09 01:50:30.099121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 141/317] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:29 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:30.276562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:30.277148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:30.278981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:30.284738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.285245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.285674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.286345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.286790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.287203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.413543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:30.421045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2c360489-7abc-4dda-9946-703a9476d77f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.148292 Sep 09 01:50:30.421621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 177/318] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:30 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:30.520523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:30.521189 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:30.523354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:30.523959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:30.527709 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.528136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.528578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.529297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.529753 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.529872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.530174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.530294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.530649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.531327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:30.531778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:30.532220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:30.602666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:30.610481 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-78c83a38-4c1e-4aec-9763-4ab9f49da07b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.094362 Sep 09 01:50:30.611130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 142/319] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:30 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:30.689317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:30.697161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-137098f5-af32-42ad-857c-249e59bf3019 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.177476 Sep 09 01:50:30.697734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 178/320] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:30 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:31.120699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:31.121371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:31.128110 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.128590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.129021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.129723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.130184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.130603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.254031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:31.261525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-94e44923-1e70-46a1-8de9-be5b6bcb9b7d tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.144620 Sep 09 01:50:31.262089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 143/321] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:31 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:31.443402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:31.444037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:31.450037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.450520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.450955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.451634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.452087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.452509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.582357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:31.590157 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-34fe7293-4bc9-42e0-a53b-37416bfd4b13 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.150727 Sep 09 01:50:31.590734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 179/322] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:31 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:31.633814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:31.634466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:31.640810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.641313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.641740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.642413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.642859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.643269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.705448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:31.712999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0370e2b8-8934-4c16-bae8-6e4697164343 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.082936 Sep 09 01:50:31.713657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 144/323] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:31 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:31.720215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:31.720827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:31.726699 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.727179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.727611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.728293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:31.728747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:31.729190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:31.857157 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:31.865420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dcf262e8-5877-4eed-883c-91964e149674 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.149157 Sep 09 01:50:31.865984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 180/324] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:31 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:32.285347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:32.285951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:32.291868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.292346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.292772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.293472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.293921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.294335 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.298162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:32.559067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:32.566630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d90cb9ad-4b86-4762-bea1-98d091f338e7 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.285801 Sep 09 01:50:32.567188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 145/325] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:32 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:32.612720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:32.613406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:32.619592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.620211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.620637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.621509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.622234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.622638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.736951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:32.738140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:32.745926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.746522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.747205 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.747892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.748341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.748756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.753097 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:32.760855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4691ba85-8fe9-4de2-bf20-3a5a19dd70b5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.151953 Sep 09 01:50:32.761683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 181/326] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:32 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:32.811562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:32.819096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-45abc6ce-6bf6-4cdd-9552-c433a4736985 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.087326 Sep 09 01:50:32.819641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 146/327] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:32 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:32.888440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:32.889094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:32.895037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.895518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.895978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:32.896657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:32.897123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:32.897540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.025092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:33.033372 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-915bdcf4-4023-4c8c-a010-07b8839f11fd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.148655 Sep 09 01:50:33.033938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 182/328] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:32 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:33.589281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:33.589880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:33.596687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.597187 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.597613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.598283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.598729 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.599143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.732389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:33.740131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ef9c6426-d93b-40b1-aeac-3ae8e3afd75a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.154687 Sep 09 01:50:33.740699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 147/329] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:33 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:33.784151 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:33.784760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:33.790644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.791125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.791555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.792234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.792683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.793125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.841354 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:33.841893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:33.848369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.848851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.849318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.850005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:33.850460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:33.850884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:33.928526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:33.936306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2a0c9b37-3e57-46fe-9930-41791a925b8b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.098881 Sep 09 01:50:33.936952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 148/330] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:33 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:33.949403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:33.957537 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9672d3d9-552d-4714-a8e4-6407954448fb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.177834 Sep 09 01:50:33.958089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 183/331] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:33 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:34.055646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:34.056366 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:34.062334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.062810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.063238 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.063911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.064357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.064767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.192309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:34.199886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f118988a-dfea-4a03-b865-7e662d211483 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.148035 Sep 09 01:50:34.200432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 149/332] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:34 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:34.763373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:34.763984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:34.770445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.770921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.771380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.772059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.772511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.772929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.909363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:34.916799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-260d437d-600b-42f9-a704-80ec21561be0 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.157249 Sep 09 01:50:34.917388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 184/333] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:34 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:34.959481 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:34.960092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:34.966431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.966914 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.967345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.968023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.968484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.968931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.981127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:34.981770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:34.987482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.987958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.988388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:34.989085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:34.989541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:34.989957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:35.031772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:35.039403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-11d7de5b-b1b5-4189-a324-8b4874939d93 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.083645 Sep 09 01:50:35.039971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 150/334] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:34 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:35.122141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:35.129746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-58e2ecf9-2309-4524-9749-a8298008851f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.152411 Sep 09 01:50:35.130306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 185/335] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:34 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:35.223637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:35.224241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:35.230767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:35.231254 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:35.231688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:35.232375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:35.232829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:35.233287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:35.366972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:35.374724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6fad4e86-cc92-4f1f-9541-882db9003224 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.155844 Sep 09 01:50:35.375312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 151/336] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:35 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:35.939236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:35.939835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:35.945703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:35.946179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:35.946602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:35.947268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:35.947714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:35.948127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.061833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:36.062566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:36.068858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.069367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.069801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.070498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.070929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.071347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.072380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:36.080500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8b66546b-dfbf-4298-b721-dbf3c6096104 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.145065 Sep 09 01:50:36.081079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 186/337] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:35 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:36.132398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:36.139831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2de7a6b3-c3c3-4fe9-ba6c-2f1733f2dd45 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1293 microversion: 2.1 time: 0.081842 Sep 09 01:50:36.140377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 152/338] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:36 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:36.151523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:36.152131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:36.158524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.159004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.159431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.160106 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.160555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.160967 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.287631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:36.295265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-baa435bb-ea4e-4544-bcf2-75f3c9ab18b8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1522 microversion: 2.1 time: 0.147470 Sep 09 01:50:36.295828 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 187/339] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:36 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:36.397586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:36.398126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:36.403869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.404345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.404774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.405482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:36.405934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:36.406430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:36.530279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:36.537782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-649ccf6c-8463-47c2-8d22-c49c00f89d9f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.144026 Sep 09 01:50:36.538333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 153/340] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:36 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:37.104017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:37.104631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:37.111160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.111638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.112070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.112750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.113233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.113650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.165011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:37.166592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:37.175175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.175805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.176373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.177325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.178026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.178583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.282969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:37.290602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff30ab87-4e47-4ac5-94b7-5d167b61a2ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1301 microversion: 2.1 time: 0.131125 Sep 09 01:50:37.291155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 154/341] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:37 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1301 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:37.317408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:37.318017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:37.325053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.325584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.326024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.326743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.327201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.327626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.368556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:37.376342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-38c308aa-8c06-44ac-8feb-af1047558f14 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.276196 Sep 09 01:50:37.376906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 188/342] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:37 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:37.467225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:37.475617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3d3a2dde-e140-49c4-8ec3-d78b36d0e66c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1502 microversion: 2.1 time: 0.162017 Sep 09 01:50:37.476166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 155/343] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:37 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:37.497088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:37.497709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:37.503550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.504027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.504455 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.505159 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.505613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.506032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.559602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:37.560204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:37.566238 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.566724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.567153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.567842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:37.568289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:37.568702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:37.679710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:37.687469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-78d817d8-e5b7-4bd5-a5e9-652eb02a2a4b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1515 microversion: 2.1 time: 0.194370 Sep 09 01:50:37.688034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 189/344] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:37 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:37.722867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:37.730459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cd37fa33-fcc5-4812-ab51-d12bbdff5ca1 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.174683 Sep 09 01:50:37.731011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 156/345] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:37 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:38.114992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230ed659-38d5-4417-ba30-7362f6b20671", "name": "network-vif-plugged", "status": "completed", "tag": "abf0e91b-cb4a-4c3c-8bc8-600df9410829"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:38.130136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.130584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.131230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.145610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] Creating event network-vif-plugged:abf0e91b-cb4a-4c3c-8bc8-600df9410829 for instance 230ed659-38d5-4417-ba30-7362f6b20671 on hv-cinder-85221 Sep 09 01:50:38.152148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-67415738-4c53-4b65-9340-d6fa8885ea82 req-7d773c76-6494-423b-9a18-ba866cbbc4fc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040831 Sep 09 01:50:38.153872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 190/346] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:50:38.314342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:38.315038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:38.322061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.322579 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.323101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.323984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.324505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.325006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.390140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:38.398586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e9fdcd01-a7d8-4a60-9df0-80a0a5db0a5c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1311 microversion: 2.1 time: 0.088150 Sep 09 01:50:38.399148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 157/347] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:38 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:38.399361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:38.400444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:38.408309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.408877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.409399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.410157 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.410768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.411324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.547865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:38.555552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0899a2d0-d371-4fd5-8807-26a1c75b0cb1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.160881 Sep 09 01:50:38.556112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 191/348] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:38 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:38.753827 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:38.754329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:38.760767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.761292 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.761725 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:38.762424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:38.762878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:38.763312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:39.062230 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:39.070334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f3ef1306-a822-4857-a418-baee1c174054 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.320600 Sep 09 01:50:39.070893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 158/349] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:38 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:39.428383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:39.429002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:39.435105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:39.435582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:39.436005 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:39.436671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:39.437146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:39.437580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:39.441557 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:39.500594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:39.508197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-36c1582a-ebe2-412a-a83b-324366dd92d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1299 microversion: 2.1 time: 0.083729 Sep 09 01:50:39.508767 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 192/350] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:39 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:39.578787 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:39.579389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:39.585907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:39.586388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:39.586816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:39.587490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:39.587938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:39.588352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:39.713470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:39.721538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-920ea33d-f733-4367-9b87-98a077db3020 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.146638 Sep 09 01:50:39.722085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 159/351] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:39 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:40.092199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:40.092802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:40.099207 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.099733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.100160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.100827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.101298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.101712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.229225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:40.237051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-39abb122-25b9-4ec3-bfe7-e8bf4296fa2a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.148667 Sep 09 01:50:40.240174 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 193/352] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:40 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:40.531226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:40.532214 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:40.538132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.538620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.539055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.539743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.540192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.540607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.623742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:40.632206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-69a0abf2-68c3-4834-90f3-c3d8b42b10ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1299 microversion: 2.1 time: 0.104847 Sep 09 01:50:40.632780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 160/353] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:40 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:40.743758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:40.744417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:40.750528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.751549 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.752005 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.752734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:40.753204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:40.753618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:40.933945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:40.941551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ca76fc4f-be57-4d8f-874b-6aa791d7f77a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.201559 Sep 09 01:50:40.942194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 194/354] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:40 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:41.261955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:41.262573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:41.269517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.270233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.270425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:41.271319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.271779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.272200 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:41.408336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:41.411781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:41.416931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-bd35c9af-1251-4f22-836e-3342619675bc tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.161238 Sep 09 01:50:41.417518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 161/355] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:41 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:41.655235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:41.655840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:41.661787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.662265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.662728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:41.663404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.663855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.664274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:41.789677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:41.797331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5a430a04-9ccd-41d8-8c3c-3929f6454374 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.145860 Sep 09 01:50:41.797900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 195/356] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:41 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:41.964617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:41.965253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:41.971602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.972080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.972513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:41.973224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:41.973680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:41.974099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.099362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:42.106836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b8564002-444c-40f0-8aeb-676830359267 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.146123 Sep 09 01:50:42.107596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 162/357] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:41 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:42.366046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:42.368410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:42.374645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.375126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.375566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.376276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.376721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.377170 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.399393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lazy-loading 'flavor' on Instance uuid f10c908e-1792-46e9-ae0a-6727f8bf4923 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:50:42.439343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:42.440057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:42.445941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.446520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.447024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.447777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.448338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.448825 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.472428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-12bb72d0-d1a7-4a4a-9413-85c480bf43f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/action" status: 200 len: 32 microversion: 2.1 time: 0.110342 Sep 09 01:50:42.473020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 196/358] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:50:42 2022] POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 01:50:42.482331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:42.483015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:42.489724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.490130 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.490555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.491237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.491684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.492093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.629948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:42.637325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1cd62149-48f3-4fbc-93fa-da333918f4d6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.202094 Sep 09 01:50:42.637888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 163/359] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:42 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:42.659215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:42.666732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3430cec5-3df3-4d79-9848-e71bb52db68f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.188291 Sep 09 01:50:42.667295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 197/360] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:42 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:42.819594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:42.820233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:42.826544 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.827021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.827447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.828118 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:42.828562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:42.829521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:42.958274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:42.965776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d24430b3-bc27-46ff-ab96-4426620e129f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.149978 Sep 09 01:50:42.966343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 164/361] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:42 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:43.129738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:43.130274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:43.136272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.136748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.137208 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.137885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.138334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.138754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.263630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:43.271132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2775399b-c867-4501-a369-06ec9cd81178 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.145253 Sep 09 01:50:43.271691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 198/362] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:43 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:43.661412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:43.662014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:43.669401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.669878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.670513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.671425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.671425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.671811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.692129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:43.692863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:43.698658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.699213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.699710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.700459 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.700985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.701497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.876748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:43.883511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:43.891112 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4d6a6e94-1795-4872-a59c-36fb10aef6d0 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.235281 Sep 09 01:50:43.891333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cebbdbb0-8ee6-42f1-9ecb-0087e0e8b81f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.203636 Sep 09 01:50:43.897482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 199/363] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:43 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:43.904992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 165/364] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:43 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:43.988682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:43.989351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:43.995221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.995702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.996131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:43.997093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:43.997543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:43.997958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.126922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:44.134533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b42fa831-953b-409d-bdfd-d1c728a8a436 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.150255 Sep 09 01:50:44.135087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 200/365] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:43 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:44.294080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:44.294604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:44.300801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.301565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.302159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.302935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.303432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.304213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.454578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:44.463270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-180886c6-4697-4b7b-a533-ae8541299ffe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1314 microversion: 2.1 time: 0.173020 Sep 09 01:50:44.464193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 166/366] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:44 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:44.922225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:44.927204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:44.928006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:44.928680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:44.940700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.941315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.942807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.943593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.944557 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.945300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.945984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.946766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.947403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:44.948326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:44.951698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:44.952381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:45.240195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:45.248418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7cd7a8ec-7b41-435e-9a0c-dd39c04abd12 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.331305 Sep 09 01:50:45.248997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 201/367] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:44 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:45.254141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:45.254743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:45.260371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:45.260858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:45.261325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:45.262014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:45.262473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:45.262894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:45.269363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:45.278008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-57ea6b04-db48-490d-8ef3-779223d45191 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.359556 Sep 09 01:50:45.278578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 167/368] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:44 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:45.490705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:45.491320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:45.497429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:45.497943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:45.498374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:45.499061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:45.499531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:45.499972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:45.644373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:45.653980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7eee4132-a6fb-4818-bc3d-a9c21e91c907 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.403915 Sep 09 01:50:45.654619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 202/369] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:45 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:46.201988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4", "name": "network-vif-plugged", "status": "completed", "tag": "99b8467e-7d03-4509-8d63-3738f12052a5"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:46.210472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:46.225539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b65b09fd-dcaa-4cd5-9ba4-7c94d1f9dcec tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1464 microversion: 2.1 time: 0.738286 Sep 09 01:50:46.228683 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 168/370] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:45 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1464 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:46.233328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.233989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.234749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.272768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:46.273767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:46.286588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.288263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.290121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.291451 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] Creating event network-vif-plugged:99b8467e-7d03-4509-8d63-3738f12052a5 for instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 on hv-cinder-85221 Sep 09 01:50:46.294535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.303879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.304333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.313634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-714ba530-cafc-4cc1-9aee-c74d7654052d req-fdaf47e0-d3ce-4407-8839-380d91bc52cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119498 Sep 09 01:50:46.317436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 203/371] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:50:46.330245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:46.330850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:46.344720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.345235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.348778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.350348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.351025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.353666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.397417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:50:46.513112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6597cf4a-64fc-46d6-a8d9-dea71dfd4040 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "DELETE /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 204 len: 0 microversion: 2.1 time: 0.192725 Sep 09 01:50:46.514134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 204/372] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:50:46 2022] DELETE /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:50:46.520164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:46.521114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:46.527986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.528487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.528916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.529815 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.530483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.530907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.634736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:46.642744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c4fe94d8-6002-44fa-b611-97d540305c1c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.373825 Sep 09 01:50:46.643392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 169/373] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:46 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:46.647794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab363ee7-d833-4edb-95de-48d7e54bc297", "tag": "717c9750-3986-4f89-9e30-f7755cacc204"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:50:46.657308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.658074 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.658508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.669409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] Creating event network-changed:717c9750-3986-4f89-9e30-f7755cacc204 for instance ab363ee7-d833-4edb-95de-48d7e54bc297 on hv-cinder-85221 Sep 09 01:50:46.674706 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-665c395b-dbcb-49c2-87dd-0da16bb392a0 req-c3a1466e-7ad5-4ce4-8207-6034acc0894d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030145 Sep 09 01:50:46.675432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 170/374] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:50:46.680478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:46.681205 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:46.687150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.687638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.688165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.689400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.689859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.690289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.695956 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:46.699435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:46.704680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e9a913ce-e0d6-43e6-9935-db154cb2b317 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.188946 Sep 09 01:50:46.705309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 205/375] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:46 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:46.710517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:46.711123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:46.718878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.719363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.719790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.720475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:46.720920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:46.721365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:46.886547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:46.895390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-17e65f8c-8a9b-48f0-97d7-f0d593f0b9b5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.218669 Sep 09 01:50:46.895963 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 171/376] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:46 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:46.912748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:46.920475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0efd0336-61e7-4c78-941e-5f31d6761ca0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.214133 Sep 09 01:50:46.920970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 206/377] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:46 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:47.664879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:47.665444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:47.671856 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.672360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.673399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.674082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.674530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.674944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.727904 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:47.728542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:47.734476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.735612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.736038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.736708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.737177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.737592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.846228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:47.853944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3fe96914-9d81-4ae0-ada3-53da76116ebe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.192925 Sep 09 01:50:47.854510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 172/378] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:47 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:47.890651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:47.898897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-eec86d68-5a9f-41ac-8228-498516dfc033 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.174280 Sep 09 01:50:47.899015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 207/379] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:47 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:47.918668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:47.919204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:47.925800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.926280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.926706 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.927381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.927829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.928244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.943029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:47.943640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:47.949577 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.950057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.950479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:47.951326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:47.951920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:47.952335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:48.166097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:48.180244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6a7da698-41b0-4271-a2f0-45075c310b58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.260119 Sep 09 01:50:48.180917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:48.181250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 173/380] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:47 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:48.193401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4c79bfc-c25c-468f-9e73-28abda93556b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.254246 Sep 09 01:50:48.194161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 208/381] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:47 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:48.877115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:48.878293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:48.884888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:48.885406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:48.885869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:48.886551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:48.887004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:48.887422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:48.921091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:48.921765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:48.928397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:48.928878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:48.929341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:48.930022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:48.930470 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:48.930879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:49.063896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:49.071640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7f927ada-1bdc-4e79-a40b-1e684ebe2407 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.198337 Sep 09 01:50:49.072218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 174/382] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:48 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:49.096526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:49.107771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-579e7ec1-f5b7-4ce8-bffb-88388711ea55 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.190580 Sep 09 01:50:49.108558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 209/383] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:48 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:49.203810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:49.204781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:49.210541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:49.211031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:49.211467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:49.212310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:49.212769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:49.213280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:49.217259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:49.217832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:49.230112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:49.230665 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:49.231094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:49.231781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:49.232232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:49.232641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:49.403095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:49.411256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-bf691ce7-c043-4173-b7c2-ab7c05ae1279 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.211336 Sep 09 01:50:49.411815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 175/384] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:49 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:49.425953 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:49.433556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-248bc6b9-150a-48bb-bd83-dd59d755d4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.220595 Sep 09 01:50:49.434115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 210/385] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:49 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:50.097623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:50.098257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:50.104843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.105351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.105786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.106465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.106918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.107338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.131264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:50.131858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:50.137913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.138388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.138810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.139478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.139919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.140328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.307466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:50.314174 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:50.315094 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a8cbb50f-b2ee-446c-b648-f57d7c108412 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.221812 Sep 09 01:50:50.315669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 176/386] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:50 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:50.322639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-75803463-4c81-4be1-8b2a-443013333069 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.195033 Sep 09 01:50:50.323419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 211/387] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:50 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:50.434811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:50.435347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:50.441830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.442313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.442744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.443429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.443882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.444303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.455677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:50.456279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:50.462068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.462544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.462972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.463649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:50.464102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:50.464519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:50.633042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:50.640879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0faceb0f-5b0f-4b49-8380-182625c0f0ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.210115 Sep 09 01:50:50.641485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 177/388] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:50 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:50.643292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:50.650857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-159c59b6-d360-45b6-b88d-d66704c58cfe tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.199008 Sep 09 01:50:50.651485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 212/389] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:50 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:51.339024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:51.339628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:51.344963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:51.345590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:51.345991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.346473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.346900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.347583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.348035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.348449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.351304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.351790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.352216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.353002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.353480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.353892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.537234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:51.543939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:51.544976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-daeb361c-5b05-4244-a950-4e0c270d6b0b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.209675 Sep 09 01:50:51.545577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 178/390] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:51 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:51.551790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4ce563a9-d795-4fed-aa20-fd1b984b0783 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.210623 Sep 09 01:50:51.552340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 213/391] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:51 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:51.663494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:51.664101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:51.670294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.670781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.671210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.671893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.672344 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.672759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.673837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:51.674445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:51.678110 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:51.680403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.680879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.681352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.682030 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:51.682477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:51.682896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:51.815431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:51.823430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9d8d9710-379d-4b23-8016-504eb0e086fe tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.163657 Sep 09 01:50:51.824028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 179/392] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:51 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:51.943771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:51.951241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-429f71b6-b839-41d6-ad43-5795d461d1c2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.281574 Sep 09 01:50:51.951798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 214/393] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:51 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:52.568030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:52.568671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:52.574595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:52.575067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.575197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:52.575552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.575991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.576687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.577167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.577589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.581494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.581977 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.582402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.583082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.583526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.583939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.889307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:52.893029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:52.897659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-40c59322-d69c-4a72-bc49-a2102a13281f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.333766 Sep 09 01:50:52.898316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 180/394] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:52 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:52.901418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cfa6cdab-c9fc-4abe-abe6-23e8c156ea4a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.330500 Sep 09 01:50:52.902057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 215/395] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:52 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:52.903121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:52.903880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:52.909735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.910212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.910641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.911326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.911775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.912188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.978336 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:52.978952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:52.984946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.985469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.985899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:52.986593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:52.987046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:52.987466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:53.075536 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:53.083982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5e0bce20-5aa6-4c40-bfdd-61ed9462779b tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.184392 Sep 09 01:50:53.084390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 181/396] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:52 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:53.138024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:53.146136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f0ade4c8-ec60-4649-a8f8-77d9d9ec727f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.171825 Sep 09 01:50:53.146688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 216/397] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:52 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:53.919745 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:53.920358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:53.925357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:53.925991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:53.927436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:53.927925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:53.928362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:53.929081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:53.929539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:53.929959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:53.931884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:53.932356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:53.932780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:53.933471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:53.933922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:53.934333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:54.117957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:54.122205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:54.125902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a15c7c4f-8049-4376-bc1a-84ac14547ffb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.209950 Sep 09 01:50:54.127005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 182/398] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:53 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:54.130699 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-89465320-51a2-469b-8ba6-5fa19c20593e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.209524 Sep 09 01:50:54.131248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 217/399] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:53 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:54.131384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:54.131985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:54.137686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:54.138161 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:54.138588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:54.139276 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:54.139728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:54.140147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:54.167410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:54.168016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:54.174471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:54.174976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:54.175409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:54.176122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:54.176570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:54.176989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:54.315677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:54.323900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-73372ecf-58c8-4e0e-af46-8a98a684d78f tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.195761 Sep 09 01:50:54.324509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 183/400] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:54 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:54.343116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:54.351598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b19c21b7-f912-45e6-803a-bf2781d1cab6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.187827 Sep 09 01:50:54.352329 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 218/401] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:54 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:55.149374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:55.149989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:55.153457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:55.154025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:55.156384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.156869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.157333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.158023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.158552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.158896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.159653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.160132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.160560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.161259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.161705 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.162144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.348062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:55.355213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:55.355845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5941f398-40d0-4382-9d59-258cecf5dc7a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.210342 Sep 09 01:50:55.356631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 184/402] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:55 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:55.360743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:55.361358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:55.362992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-960c8f84-885a-430a-9317-1ff6a88deb2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.213790 Sep 09 01:50:55.363720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 219/403] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:55 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:55.366999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.367479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.369459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.369459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.369459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.369923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.375509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:55.376603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:55.382441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.382924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.383356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.384046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:55.384494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:55.385477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:55.565220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:55.568332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:55.572890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f6f8580b-3d72-4cd2-8d86-5f2daa135b3a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.215546 Sep 09 01:50:55.573562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 185/404] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:55 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:55.575985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-833fc975-71a5-4c5a-bb70-a63cadb055ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.204294 Sep 09 01:50:55.576533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 220/405] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:55 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:56.377875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:56.378510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:56.384977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.385491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.385874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:56.386271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.386481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:56.386590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.387038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.387461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.392769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.393286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.393717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.394396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.394845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.395260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.583203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:56.587104 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:56.592415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3ca5a045-88ec-4555-8c08-3947b8c7ec8a tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.208916 Sep 09 01:50:56.592415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 221/406] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:56 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:56.595923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2009f53d-027a-4d72-a246-b503b66219a2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.221760 Sep 09 01:50:56.596067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:56.596645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 186/407] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:56 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:56.600912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:56.601555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:56.607470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.607681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:56.607958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.608390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.609092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.609561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.609985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.613990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.614545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.615038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.615784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:56.616296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:56.616769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:56.636169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:56.800695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:56.803935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:56.808403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c66130ba-6694-4b68-88a1-bfd982c02247 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.210972 Sep 09 01:50:56.808973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 187/408] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:56 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:56.811460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6a09cf27-406f-46cd-b5a6-3fbba0762404 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.218900 Sep 09 01:50:56.812006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 222/409] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:56 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:57.613026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:57.613659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:57.618169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:57.618766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:57.620096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.620584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.621014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.621984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.622437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.622854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.624742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.625252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.625682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.626416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.626860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.627268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.813085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:57.815863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:57.820813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8cc785ab-dce0-475d-9e08-38f83aae43fe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.206297 Sep 09 01:50:57.821409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 223/410] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:57 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:57.824686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-32755258-84ab-4002-93a2-409f3e104d2b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.216073 Sep 09 01:50:57.826475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 188/411] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:57 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:57.832216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:57.832814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:57.834582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:57.840600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:57.841228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:57.847835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.848002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.848296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.848413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.848750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.848871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.849455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.849582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:57.849905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.850020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:57.850314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:57.850433 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:58.045466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:58.048598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:58.053278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-06f0801a-101f-4abc-8511-a74eb1549096 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.225356 Sep 09 01:50:58.053840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 224/412] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:57 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:58.056327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ea5897b1-7e5b-41ce-85dc-dd83397901ce tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.219402 Sep 09 01:50:58.056875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 189/413] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:57 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:58.846587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:58.847201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:58.847668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:58.848265 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:58.853119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:58.853612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:58.854041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:58.854388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:58.854721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:58.854869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:58.855167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:58.855282 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:58.855584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:58.855971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:58.856425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:58.856845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:59.308725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:59.313284 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:59.316838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9b3acee1-e83b-4326-8e61-7556ff12f22b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.474660 Sep 09 01:50:59.317452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 225/414] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:58 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:59.321854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:59.322452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:59.328608 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:59.329634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:59.330065 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:59.330970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:59.331422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:59.332059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:59.332446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e5a460fb-bcb8-4f1a-ad9d-703b7de1757e tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.488867 Sep 09 01:50:59.333235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 190/415] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:58 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:50:59.343266 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:50:59.343870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:50:59.347472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:50:59.351303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:59.351814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:59.352246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:59.352931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:50:59.354041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:50:59.354594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:50:59.535911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:59.539628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:50:59.544164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4de01b0-fb53-47d4-92ef-e87cd8da4ebc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.225727 Sep 09 01:50:59.545093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 226/416] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:59 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:50:59.549680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e3e84748-3368-4955-ad52-d68a827f8970 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.210200 Sep 09 01:50:59.561084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 191/417] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:50:59 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:00.194726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230ed659-38d5-4417-ba30-7362f6b20671", "name": "network-vif-unplugged", "status": "completed", "tag": "abf0e91b-cb4a-4c3c-8bc8-600df9410829"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:00.204535 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.205006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.205448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.216787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] Creating event network-vif-unplugged:abf0e91b-cb4a-4c3c-8bc8-600df9410829 for instance 230ed659-38d5-4417-ba30-7362f6b20671 on hv-cinder-85221 Sep 09 01:51:00.221776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-b5ed4e35-cb7e-4f56-8853-05ad11b6b492 req-9b89a78e-dcd5-43d6-a4fb-8b5c3109ab3b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030720 Sep 09 01:51:00.222359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 227/418] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:00.342315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:00.342927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:00.349929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.350505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.350930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.351617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.352073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.352495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.355663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:00.356360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:00.362882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.363356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.363780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.364458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.364899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.365335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.543135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:00.550164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:00.551047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f1e7c894-2c46-4208-b8c5-5d26ba9ce636 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.212610 Sep 09 01:51:00.551792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 192/419] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:00 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:00.557745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7ab00211-001f-4541-bc55-720af96575e3 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1314 microversion: 2.1 time: 0.206148 Sep 09 01:51:00.561462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 228/420] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:00 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:00.568700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:00.569415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:00.575259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.575849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.576280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.576964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.580226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.580226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.580396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:00.581156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:00.588161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.588641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.589094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.590265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:00.590265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:00.590617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:00.868743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:00.879863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b58810f7-102b-406f-9fb3-1839af56ce94 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.315331 Sep 09 01:51:00.880687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 193/421] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:00 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:00.886521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:00.904827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d649fc4a-03fa-494e-81d3-d0190eb5ee41 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1470 microversion: 2.1 time: 0.331437 Sep 09 01:51:00.921442 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 229/422] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:00 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:01.546353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230ed659-38d5-4417-ba30-7362f6b20671", "name": "network-vif-deleted", "tag": "abf0e91b-cb4a-4c3c-8bc8-600df9410829"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:01.556586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.557164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.557659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.569319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] Creating event network-vif-deleted:abf0e91b-cb4a-4c3c-8bc8-600df9410829 for instance 230ed659-38d5-4417-ba30-7362f6b20671 on hv-cinder-85221 Sep 09 01:51:01.574445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-7d15f249-04db-45ae-8343-2b2ff458d2b5 req-8dec7406-4793-4c05-b963-b701c87d0c94 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 Sep 09 01:51:01.574993 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:01.575434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 194/423] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:01.575688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:01.584540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.584755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:01.585260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.585476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:01.585694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.586391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.586874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.587298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.591758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.592371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.592804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.593525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.593977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.595072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.824830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:01.829613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:01.834517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1603f05a-cf7a-4cf4-9a2f-319d8070ec28 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1497 microversion: 2.1 time: 0.253694 Sep 09 01:51:01.835179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 195/424] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:01 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:01.839216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c5c6a54f-96a9-4748-8a34-57f71806d022 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.268076 Sep 09 01:51:01.839794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 230/425] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:01 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:01.903785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:01.904397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:01.910363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.910849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.911280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.911965 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.912417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.912840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.928935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:01.929682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:01.931269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:01.935801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.936357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.936850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:01.937627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:01.938793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:01.939610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:02.014947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:02.023623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1f35c5c2-e0cb-49e8-8bf3-19dc146228ac tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1299 microversion: 2.1 time: 0.098371 Sep 09 01:51:02.024180 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 231/426] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:01 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:02.070296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:02.077900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9c32f0be-3c36-4edc-8a93-abfb4e5bd0df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.179003 Sep 09 01:51:02.078464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 196/427] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:01 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:02.861971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:02.862777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:02.868657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:02.869171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:02.869619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:02.870293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:02.870738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:02.871181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.006115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:03.019540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-57aba52c-6e0f-493c-99d3-70130d79538f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.160467 Sep 09 01:51:03.020129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 232/428] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:02 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:03.047861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:03.049201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:03.061289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.061289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.061289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.061289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.061686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.061686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.078311 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:03.078802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:03.084883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.085390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.086009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.086765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.087218 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.087667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.118536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:51:03.139274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:03.153596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6869c60e-cbef-4db4-8e0d-d39d550570a1 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1299 microversion: 2.1 time: 0.110676 Sep 09 01:51:03.154171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 197/429] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:03 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:03.162630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:03.163441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:03.176318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.176812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.177421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.178025 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.178404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.178823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.217133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-64b0a138-f7a8-4af1-bebc-e31e42cbfcab tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 204 len: 0 microversion: 2.1 time: 0.142240 Sep 09 01:51:03.218112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 233/430] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:51:03 2022] DELETE /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 01:51:03.228990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:03.229976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:03.237953 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.238666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.239254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.240178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:03.240780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:03.241387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:03.386587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:03.396244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7613934a-4038-46c0-903b-6e989cf718fa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.237758 Sep 09 01:51:03.405092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 198/431] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:03 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:03.421527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:03.427477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e00b6842-dd07-4ca2-8a61-55c4bc89070c tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1503 microversion: 2.1 time: 0.203106 Sep 09 01:51:03.428045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 234/432] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:03 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:04.043343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:04.043994 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:04.049819 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.050369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.050723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.051406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.051860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.052280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.182267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:04.183425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:04.187657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:04.190984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.191500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.191927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.192813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.193286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.193713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.196460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-18bc5318-b49e-4be7-9403-70fd01a94cf9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.156882 Sep 09 01:51:04.197087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 199/433] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:04 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:04.258575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:04.267209 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7cc9d9ef-42da-490c-92a1-3763feef1b0a tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1299 microversion: 2.1 time: 0.092666 Sep 09 01:51:04.267813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 235/434] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:04 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:04.419690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:04.420303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:04.427355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.428491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.429193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.430699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.430699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.431139 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.459963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:04.462348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:04.469704 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.470241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.470829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.472021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:04.472625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:04.473233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:04.785654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:04.799286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:04.805336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8d8cfd0c-abd6-4056-906d-0dd14f61088b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.387462 Sep 09 01:51:04.806469 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 200/435] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:04 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:04.807929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-45a6a885-c41c-4fd3-ad11-93361a3e7fc7 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1503 microversion: 2.1 time: 0.356548 Sep 09 01:51:04.823534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 236/436] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:04 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:05.221937 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:05.223065 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:05.231813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.232497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.233051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.233908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.234439 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.236000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.290053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:05.290657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:05.298816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.302366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.302883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.304423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.306744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.307267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.360321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.360947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.362099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.362099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lazy-loading 'fault' on Instance uuid 230ed659-38d5-4417-ba30-7362f6b20671 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:51:05.421510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:05.425964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:05.426678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:05.435067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2871dc22-b616-44bc-849e-0624f4279c58 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1304 microversion: 2.1 time: 0.148024 Sep 09 01:51:05.436251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b7037710-f852-44e8-b65b-ed1c72a6af93 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.219608 Sep 09 01:51:05.437339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 237/437] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:05 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:05.446849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 201/438] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:05 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:05.839701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:05.840513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:05.841141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:05.843501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:05.852986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.853504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.853938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.858810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.860651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.861391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.862237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.862943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:05.863396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.863800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:05.864467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:05.868845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.124919 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:06.133536 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9dacf64f-233f-4e7c-97e7-fbb525d48a96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1503 microversion: 2.1 time: 0.304774 Sep 09 01:51:06.137899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 202/439] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:05 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:06.138048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:06.146817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c107ce7a-c00e-49a2-a879-866cd3500174 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.319456 Sep 09 01:51:06.148075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 238/440] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:05 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:06.466905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:06.467541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:06.468515 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:06.469666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:06.478189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:06.478688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:06.479135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.479837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:06.480293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:06.480712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.486187 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:06.486941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:06.487533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.488381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:06.489116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:06.492991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.541766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:06.543191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:06.543789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:06.544925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lazy-loading 'fault' on Instance uuid 230ed659-38d5-4417-ba30-7362f6b20671 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:51:06.707210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56ff8a77507c43fba14f0d997cc912ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b88c8a0deaaa4aba915ef5e2c32a427b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:06.715205 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f8839af7-4258-405e-a1d4-d764d4a895d5 tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 200 len: 1304 microversion: 2.1 time: 0.259212 Sep 09 01:51:06.717106 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 203/441] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:06 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 1304 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:06.953826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:06.966533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-45d9db6c-f072-46c7-b73f-99502c67cd15 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.508088 Sep 09 01:51:06.969424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 239/442] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:06 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:07.175853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:07.176735 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:07.186244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:07.187225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:07.191353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.192115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.192700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.195220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.195873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.196453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.200204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.201655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.207702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.209885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.213002 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.216898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.634880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:07.650170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:07.651450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a4061059-d491-4d41-b433-8243a9a40a96 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.480013 Sep 09 01:51:07.652756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 240/443] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:07 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:07.658090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f1ef8db8-5e76-4b36-9130-79b39c5d6350 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 200 len: 1503 microversion: 2.1 time: 0.486501 Sep 09 01:51:07.658842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 204/444] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:07 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:07.708540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4", "name": "network-vif-deleted", "tag": "99b8467e-7d03-4509-8d63-3738f12052a5"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:07.718501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.718995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.719429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.744288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] Creating event network-vif-deleted:99b8467e-7d03-4509-8d63-3738f12052a5 for instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 on hv-cinder-85221 Sep 09 01:51:07.748949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:07.749791 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] [instance: 230ed659-38d5-4417-ba30-7362f6b20671] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:07.750366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-4a956cdc-f5b0-4570-aa20-50fd661728ef req-ba4ec98f-6cf2-4a3a-a96f-04a64192f98e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045261 Sep 09 01:51:07.751686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 241/445] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:07.757443 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.757929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.758355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.759044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:07.759493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:07.759907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:07.775616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] HTTP exception thrown: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Request method failure captured: Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 HTTP/1.1 Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvLPCXKqyNqP_I76kjaZ61C4rt0JIkW56fxtSZzeDyNE0gH7YgRzgyt8-UZE1wdX1z_VV1MQuQKuq1exC0jgyIJMc6OtKW0J1iFuY8YQikMhrQp1HbBm8zTKZf-O84GI8IdQEDMo6B5YR80sA0gpRTdNytJMM2sybI3Hw2JxHYx1QY Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: b88c8a0deaaa4aba915ef5e2c32a427b Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesNegativeTest-1074759309 Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:51:07.781077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b88c8a0deaaa4aba915ef5e2c32a427b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b88c8a0deaaa4aba915ef5e2c32a427b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b88c8a0deaaa4aba915ef5e2c32a427b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b88c8a0deaaa4aba915ef5e2c32a427b", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesNegativeTest-1074759309 Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: b88c8a0deaaa4aba915ef5e2c32a427b Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesNegativeTest-1074759309 Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesNegativeTest-1074759309-project Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 56ff8a77507c43fba14f0d997cc912ec Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesNegativeTest-1074759309-project Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. Sep 09 01:51:07.783319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '230ed659-38d5-4417-ba30-7362f6b20671'} Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:51:07.784157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. Sep 09 01:51:07.785632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:07.786811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] Returning 404 to user: Instance 230ed659-38d5-4417-ba30-7362f6b20671 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:51:07.786811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c0e74f44-8851-40f2-b462-76aeb62273cb tempest-VolumesNegativeTest-1074759309 tempest-VolumesNegativeTest-1074759309-project] 10.222.0.15 "GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671" status: 404 len: 111 microversion: 2.1 time: 0.040744 Sep 09 01:51:07.786811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 205/446] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:07 2022] GET /compute/v2.1/servers/230ed659-38d5-4417-ba30-7362f6b20671 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:51:07.995955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:07.997092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:08.003800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.004404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.004839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.005952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.006524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.007004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.168739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:08.192075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c88fe8a5-4d0e-4fae-a8b1-9f336b5ec925 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.200520 Sep 09 01:51:08.192657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 242/447] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:07 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:08.376336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab363ee7-d833-4edb-95de-48d7e54bc297", "name": "network-vif-plugged", "status": "completed", "tag": "717c9750-3986-4f89-9e30-f7755cacc204"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:08.386077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.386583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.387006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.400752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] Creating event network-vif-plugged:717c9750-3986-4f89-9e30-f7755cacc204 for instance ab363ee7-d833-4edb-95de-48d7e54bc297 on hv-cinder-85221 Sep 09 01:51:08.406059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-22b433a3-d505-4004-8416-1c5fe0a5fd8d req-5e364d6c-723e-4ab8-971f-e4b13ab353a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033368 Sep 09 01:51:08.407419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 206/448] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:08.698024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:08.699690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:08.701750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:08.702320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:08.712072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.712806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.713306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.713625 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.713826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.714366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.714962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.715251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:08.715709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.715885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:08.716129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.716596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:08.742329 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] HTTP exception thrown: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Request method failure captured: Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 HTTP/1.1 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvBQ4X3lNroFbtkz_w2_kgntQ2h9p4G0YWSwKkN4BrET3VbC23zjsl6gkZWDHTRZ1KdEje6zSsAqKvAFfdYfAjnVCN_mR8EGshENkAPdc9inqPfY-MR60fPvVfC8OyDVzOU6siUdptbKyg7jzGOKy3tiVd5Gn2LIua1igvpNXEJIMo Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: f4e0c857a31147f8afe25e68cc3e9f24 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:51:08.744394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4e0c857a31147f8afe25e68cc3e9f24", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: f4e0c857a31147f8afe25e68cc3e9f24 Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesActionsTest-1495466188-project Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 6f366d6ae3b4404f9fa4343913f67998 Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesActionsTest-1495466188-project Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. Sep 09 01:51:08.747003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4'} Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:51:08.748358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. Sep 09 01:51:08.749739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:51:08.753201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Returning 404 to user: Instance cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:51:08.754283 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-424f9f49-bffd-4bad-b805-82b4fa733e96 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4" status: 404 len: 111 microversion: 2.1 time: 0.068158 Sep 09 01:51:08.755334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 243/449] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:08 2022] GET /compute/v2.1/servers/cbb37b9e-048d-4e59-b40e-3ae00c5b0bf4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:51:08.932801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1905599598", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "networks": [{"uuid": "42295414-a394-45f7-a204-20fad43f09ee"}]}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:08.963460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:08.971532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7bae7db6-1642-4ced-99ec-d5b2e8095333 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.284270 Sep 09 01:51:08.972118 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 207/450] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:08 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:09.031272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] validate_networks() for [('42295414-a394-45f7-a204-20fad43f09ee', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:51:09.218169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:09.218769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:09.225655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:09.226137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:09.226570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:09.227263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:09.227713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:09.228123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:09.759464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:09.768575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8851219a-a991-4656-9a8d-c785216b07a8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.554240 Sep 09 01:51:09.769468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 208/451] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:09 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:09.786705 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:51:09.787731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:51:09.788195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:51:09.788596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:51:09.788999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:51:09.802302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:09.803081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:09.803931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:09.804523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:09.805123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:09.805570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:09.827125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Getting quotas for project f4e0c857a31147f8afe25e68cc3e9f24. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:51:09.831800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Getting quotas for user 6f366d6ae3b4404f9fa4343913f67998 and project f4e0c857a31147f8afe25e68cc3e9f24. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:51:09.843083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:51:09.845454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:51:09.894888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b8013d04-eb7b-444f-b627-39157fad995b tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965768 Sep 09 01:51:09.899797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 244/452] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 01:51:09.911219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d342b0a7-8010-43ef-8c5d-0c8bc9e1b2ef tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:09.911907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d342b0a7-8010-43ef-8c5d-0c8bc9e1b2ef tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:09.991659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d342b0a7-8010-43ef-8c5d-0c8bc9e1b2ef tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:09.996745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:10.000948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d342b0a7-8010-43ef-8c5d-0c8bc9e1b2ef tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1214 microversion: 2.1 time: 0.093822 Sep 09 01:51:10.001458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 209/453] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:09 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:10.008237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:10.021027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:10.021952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:10.022683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:10.023851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:10.025714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:10.026290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:10.197389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:10.209212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-52040ac8-019a-4496-9f24-70cbd925cead tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1366 microversion: 2.1 time: 0.216914 Sep 09 01:51:10.225774 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 245/454] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:09 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:10.791848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:10.792545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:10.799257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:10.799676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:10.800102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:10.800782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:10.801317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:10.801671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:10.939324 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:10.947210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-43907a9e-50ac-4dec-8570-6b81003700bc tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.159130 Sep 09 01:51:10.947597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 210/455] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:10 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:11.023463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:11.024076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:11.029974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.030576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.032548 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.033694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.034092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.034610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.120089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:11.130051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-42321849-93fd-4663-be4d-9428933d2aad tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1210 microversion: 2.1 time: 0.110363 Sep 09 01:51:11.130825 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 246/456] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:11 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:11.235418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:11.236404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:11.242504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.243168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.243782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.244626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.245513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.246355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.399003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:11.406653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-027ba7b9-bc45-4fe4-9013-614e6d7b7bde tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1555 microversion: 2.1 time: 0.175897 Sep 09 01:51:11.407209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 211/457] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:11 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:11.430771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:11.431278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:11.438185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.438746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.439263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.440022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.440544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.441034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.529019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-26880985-3dd4-4a1b-b184-19f52cec9b7c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102908 Sep 09 01:51:11.529650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 247/458] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:51:11 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:11.970540 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:11.971288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:11.977707 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.978190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.978615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:11.979293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:11.979823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:11.980242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:12.154527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:12.155150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:12.161260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:12.161829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:12.162332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:12.163021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:12.163473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:12.163890 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:12.189183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:12.201931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e6927343-c7ac-49eb-ab6d-0f0d629551da tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.235235 Sep 09 01:51:12.202566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 212/459] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:11 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:12.255530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:12.265165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-30842918-980a-47f2-a38f-c15cc0c18885 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1274 microversion: 2.1 time: 0.114501 Sep 09 01:51:12.265747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 248/460] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:12 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:12.583964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab363ee7-d833-4edb-95de-48d7e54bc297", "tag": "717c9750-3986-4f89-9e30-f7755cacc204"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:12.595674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:12.596144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:12.596570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:12.616717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] Creating event network-changed:717c9750-3986-4f89-9e30-f7755cacc204 for instance ab363ee7-d833-4edb-95de-48d7e54bc297 on hv-cinder-85221 Sep 09 01:51:12.634764 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-5b8a3397-f874-4396-845d-e2da602b6768 req-50b8425f-b43c-45b1-a2ab-9c649d0a361e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054147 Sep 09 01:51:12.635924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 213/461] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:51:13.231730 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:13.232503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:13.246892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:13.247541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:13.248254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:13.249303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:13.250048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:13.253662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:13.291283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:13.292688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:13.306069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:13.309092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:13.309784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:13.310941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:13.313094 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:13.316712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:13.474879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:13.489921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8b4077f3-4b9b-410e-bbec-f72243b749e5 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1272 microversion: 2.1 time: 0.203613 Sep 09 01:51:13.491000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 214/462] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:13 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1272 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:13.768692 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:13.777871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bcdd98d2-389e-4f40-ba77-6372ce31efcd tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.554095 Sep 09 01:51:13.778822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 249/463] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:13 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:14.515479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:14.517172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:14.526001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:14.526706 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:14.527859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:14.528925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:14.530218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:14.530800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:14.801465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:14.802694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:14.812406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:14.813318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:14.814003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:14.815413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:14.817601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:14.819253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:14.917872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:14.923497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:14.932651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-05332c7a-7af4-4d9a-bf5f-a8e4fa8bca1f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.421981 Sep 09 01:51:14.949199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 215/464] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:14 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:15.217513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:15.229910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b57fa4ae-01d7-425c-b2b6-c17b6a19ff0d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.432085 Sep 09 01:51:15.253896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 250/465] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:14 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:15.960497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:15.962349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:15.972259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:15.973167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:15.973850 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:15.974988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:15.975675 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:15.976318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.232011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:16.244543 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-49154b6d-da1d-40e5-a0f2-b95e988eefdd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.289653 Sep 09 01:51:16.245329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 216/466] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:15 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:16.260642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:16.260642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:16.268702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.269253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.269684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.270379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.270823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.273148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.455472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6098281-5bcd-455f-ba61-e670588fb887", "tag": "60493554-0ebf-41c9-9de1-47644343d2db"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:16.476918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.477525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.478027 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.491740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] Creating event network-changed:60493554-0ebf-41c9-9de1-47644343d2db for instance c6098281-5bcd-455f-ba61-e670588fb887 on hv-cinder-85221 Sep 09 01:51:16.497193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-36ddec25-279a-4d96-80d5-d283ef0da852 req-ce678823-bc67-4ee9-818f-991687482fca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045800 Sep 09 01:51:16.498394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 217/467] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:16.684793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:16.697804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ec433704-321a-45b1-96ae-246e625a0040 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1501 microversion: 2.1 time: 0.441702 Sep 09 01:51:16.698388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 251/468] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:16 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:16.726410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56ecf5db-2df3-4f28-bc93-8a789d5574db"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:16.729322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:16.740272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.745735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.746575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.747448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.748146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.749655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.797427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] HTTP exception thrown: Cannot 'attach_volume' instance f10c908e-1792-46e9-ae0a-6727f8bf4923 while it is in vm_state rescued Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Request method failure captured: Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/os-volume_attachments HTTP/1.1 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 74 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptyaCAmKuxdV93bhtYJbYv4rqJ5x0w_r5SWUS4684TBJ2fVu57gzwqawQ42RNEFcQJL_6N3_bw5TSrLR8-6_WXuc0QhjIWtvRiq-0QBBHsBEGdt-ZGKZK-ILeom5L9geBDVm_-GlrvLOniHepN_n40swMjxeBS8UjNV_vFgqbYaD1k Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:51:16.799480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6b35000faf844d758c12de9938c235a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6b35000faf844d758c12de9938c235a8", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 3153c9ff011f4ab8958fc49795e6f8f1 Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {"volumeAttachment": {"volumeId": "56ecf5db-2df3-4f28-bc93-8a789d5574db"}} Sep 09 01:51:16.801090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Cannot 'attach_volume' instance f10c908e-1792-46e9-ae0a-6727f8bf4923 while it is in vm_state rescued Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'server_id': 'f10c908e-1792-46e9-ae0a-6727f8bf4923', 'body': {'volumeAttachment': {'volumeId': '56ecf5db-2df3-4f28-bc93-8a789d5574db'}}} Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:51:16.801956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f10c908e-1792-46e9-ae0a-6727f8bf4923 while it is in vm_state rescued Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:16.803237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:16.804643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:51:16.804643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:51:16.804643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f10c908e-1792-46e9-ae0a-6727f8bf4923 while it is in vm_state rescued Sep 09 01:51:16.804643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:16.804643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Returning 409 to user: Cannot 'attach_volume' instance f10c908e-1792-46e9-ae0a-6727f8bf4923 while it is in vm_state rescued {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:51:16.805614 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5102220d-91a4-482f-96e9-3afdf2475bfa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083749 Sep 09 01:51:16.806760 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 218/469] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:51:16 2022] POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 01:51:16.819936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:16.821483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:16.828046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.828935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.829556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.830361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.831038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.831536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.938928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8be7d07d-1de3-4491-aab7-4562a246d7bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/action" status: 202 len: 0 microversion: 2.1 time: 0.126818 Sep 09 01:51:16.943024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 252/470] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:51:16 2022] POST /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:51:16.950269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:16.951280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:16.960067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.962874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.966143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:16.967067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:16.970970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:16.971891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:17.268584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:17.269318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:17.280782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:17.282118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:17.282560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:17.283267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:17.289683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:17.290163 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:17.415720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:17.427105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-feef2287-f78f-4b42-872b-81403600b82f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.480471 Sep 09 01:51:17.428441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 219/471] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:16 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:17.770912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:17.801293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8fc8cb7e-d8cb-4c76-9d39-6f5373dde58f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.537305 Sep 09 01:51:17.805368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 253/472] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:17 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:18.451833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:18.452441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:18.463426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:18.466762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:18.467390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:18.470907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:18.471562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:18.476460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:18.699129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:18.707458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0f05fb58-2f88-48e7-93f0-f4f04f7d7629 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.259403 Sep 09 01:51:18.709752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 220/473] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:18 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:18.831051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:18.831804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:18.838632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:18.839178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:18.839717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:18.840465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:18.840992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:18.841555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:19.020371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:19.029921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f12448ed-2f2c-4ab7-a430-d3643db84573 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.205727 Sep 09 01:51:19.030507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 254/474] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:18 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:19.734722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:19.735194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:19.742882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:19.742995 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:19.743417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:19.744089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:19.744720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:19.745531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:19.888116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:19.902318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-baddbc54-274d-4994-83db-9a1c7f1b8dcf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.171461 Sep 09 01:51:19.902922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 221/475] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:19 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:20.057234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:20.057975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:20.063247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:20.064339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:20.069344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:20.070361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:20.071044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:20.071689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:20.072410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:20.072764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:20.495890 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:20.501816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:20.508570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-01988816-cd0b-49de-96dc-fef7d95de360 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.455478 Sep 09 01:51:20.509160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 255/476] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:20 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:20.929548 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:20.930177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:20.932213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:20.939742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:20.940249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:20.940695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:20.941459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:20.941898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:20.946967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:21.255819 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:21.275757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-35ba56f4-cc57-4e69-a03e-6b3494975a33 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.354217 Sep 09 01:51:21.280029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 222/477] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:20 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:21.532386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:21.533162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:21.541741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:21.542905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:21.543640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:21.544643 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:21.551548 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:21.552361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:21.828861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:21.838663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9133b086-4a4d-4f86-9ec1-1f22238b0a76 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.310413 Sep 09 01:51:21.839851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 256/478] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:21 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:22.303727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:22.304996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:22.317426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:22.318176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:22.318814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:22.321467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:22.323262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:22.323870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:22.595505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:22.610213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ae9e0d7f-3320-4dcf-b385-8fd349578a5a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.308992 Sep 09 01:51:22.626053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 223/479] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:22 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:22.866352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:22.868416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:22.876918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:22.877471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:22.877912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:22.878740 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:22.879195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:22.879618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:23.324925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:23.335245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-283a7944-3da8-45b9-bf55-1ccbb36636b4 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.475237 Sep 09 01:51:23.350142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 257/480] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:22 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:23.643783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:23.644386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:23.651144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:23.651876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:23.652314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:23.653012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:23.653643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:23.654222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:23.885895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:23.896218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f91f20af-a057-4776-9311-526bdd3b81f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1509 microversion: 2.1 time: 0.256244 Sep 09 01:51:23.912030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 224/481] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:23 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:24.361141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:24.361971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:24.368769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:24.369360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:24.370008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:24.370777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:24.371584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:24.372074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:24.608146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:24.616153 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8bfe808a-02c8-4799-bf18-aeca018c6e2f tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.260132 Sep 09 01:51:24.616723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 258/482] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:24 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:24.919609 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:24.921043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:24.927659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:24.928470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:24.929155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:24.930168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:24.931004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:24.931639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:25.184661 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6098281-5bcd-455f-ba61-e670588fb887", "name": "network-vif-plugged", "status": "completed", "tag": "60493554-0ebf-41c9-9de1-47644343d2db"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:25.203584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:25.206018 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:25.206623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:25.234863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:25.239246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] Creating event network-vif-plugged:60493554-0ebf-41c9-9de1-47644343d2db for instance c6098281-5bcd-455f-ba61-e670588fb887 on hv-cinder-85221 Sep 09 01:51:25.250163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6f034e02-17f9-4ae0-bd72-debb5687c21e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1515 microversion: 2.1 time: 0.332493 Sep 09 01:51:25.251530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-11f2856f-c699-4c11-91f5-d1ec09a6fd2f req-141f4bae-9f70-4c18-8aad-543a280e6b05 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070693 Sep 09 01:51:25.251900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 225/483] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:24 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:25.254075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 259/484] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:51:25.643662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:25.645634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:25.645899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-658a3b14-2a14-4abf-94d4-91e327e76b9b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Action: 'create', calling method: .version_select at 0x7f87d8727700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-785472344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXLdFRLuHjSE+YikzSxum89yAJJq2Bh0Pe3IY5jkLZChan5G0Jsp5oRwRN5xWSu6lzwMtGmWITzujplsapKyz2ME3pZk39zCTG2KcnNOET7pMjW/ZWaKGLxbuWaQ31bqQ=="}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:25.660581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:25.663996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:25.667661 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:25.669014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:25.671923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:25.673724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:25.704920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-658a3b14-2a14-4abf-94d4-91e327e76b9b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for project 826001ffb29b4d42a5c299154c17b93e. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:51:25.711493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-658a3b14-2a14-4abf-94d4-91e327e76b9b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for user fa5465b818f34778a1d51278653488ed and project 826001ffb29b4d42a5c299154c17b93e. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:51:25.768059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-658a3b14-2a14-4abf-94d4-91e327e76b9b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.478967 Sep 09 01:51:25.769234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 226/485] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:51:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:26.191323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:26.201453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f8e3d964-9763-4285-a3ef-bb329bd7a7dd tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.564664 Sep 09 01:51:26.202057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 260/486] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:25 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:27.225617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:27.226501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:27.235419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:27.235951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:27.236820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:27.238039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:27.238748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:27.239183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:27.477701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:27.485588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-784b0905-098d-45b0-a8c9-ad627fbc6195 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1314 microversion: 2.1 time: 0.264624 Sep 09 01:51:27.486156 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 227/487] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:27 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:27.884041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8c20b01d-39d6-4809-a563-4cdf6b143972 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: .version_select at 0x7f87d88704c0>, body: {"keypair": {"name": "tempest-keypair-354544929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4X/cfyqftSS9Yq+EprVwvtKo3yEEjI/dJpBwhXo4TRorKL6ZRyDZ3ldKvDP004G3ACPfl1h/IJMdvJ24hnCiMv3yKvaD82wQEoxmn+ZA0o1tMk0mRvyaNbquB3Ir5lgA=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:27.893944 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:27.908464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-8c20b01d-39d6-4809-a563-4cdf6b143972 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for project 6b35000faf844d758c12de9938c235a8. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:51:27.912349 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-8c20b01d-39d6-4809-a563-4cdf6b143972 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for user 3153c9ff011f4ab8958fc49795e6f8f1 and project 6b35000faf844d758c12de9938c235a8. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:51:27.967679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8c20b01d-39d6-4809-a563-4cdf6b143972 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087735 Sep 09 01:51:27.969037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 261/488] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:51:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:28.510879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:28.511597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:28.520467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:28.521321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:28.522056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:28.523568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:28.524521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:28.525197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:28.738298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:28.746712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-927e62a3-92d6-4d32-9357-4d2cb8e373e6 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1497 microversion: 2.1 time: 0.241055 Sep 09 01:51:28.747417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 228/489] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:28 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1497 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:29.484833 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1770501441", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a438537-4f4f-4149-a51c-6d26a9806efa"}], "security_groups": [{"name": "tempest-securitygroup--1619716897"}], "key_name": "tempest-keypair-354544929", "user_data": "}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:29.602474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] validate_networks() for [('7a438537-4f4f-4149-a51c-6d26a9806efa', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:51:29.966493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:51:29.966916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:51:29.967386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:51:29.967826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:51:29.968256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:51:29.976974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:29.977440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:29.977877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:29.978602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:29.979060 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:29.979513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:30.004022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:51:30.008449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Getting quotas for user 3153c9ff011f4ab8958fc49795e6f8f1 and project 6b35000faf844d758c12de9938c235a8. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:51:30.020074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:51:30.022476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:51:30.069127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7326faf8-e0d8-4f35-9098-9f7339f86d03 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.594816 Sep 09 01:51:30.069770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 262/490] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:51:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:51:30.081530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-309b4675-4327-427a-b1c9-d9ce1dd47678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:30.082140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-309b4675-4327-427a-b1c9-d9ce1dd47678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:30.084412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:30.138614 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-309b4675-4327-427a-b1c9-d9ce1dd47678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:30.145656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-309b4675-4327-427a-b1c9-d9ce1dd47678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1245 microversion: 2.1 time: 0.068021 Sep 09 01:51:30.146222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 229/491] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:30 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:31.167753 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:31.168314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:31.174916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:31.175393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:31.175826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:31.176505 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:31.176951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:31.177391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:31.237921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:31.246393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-98540ca6-93da-42d5-a343-6585b81035b4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1249 microversion: 2.1 time: 0.082246 Sep 09 01:51:31.246959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 263/492] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:31 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:32.248314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:32.248815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:32.254851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.255332 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.255765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.256444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.256894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.257340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.269920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:32.270634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:32.276894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.277480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.277988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.278771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.279296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.279784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.285532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:51:32.349707 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:32.363173 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cbe4f9c4-cdb8-4803-8c6f-436e51641b2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1297 microversion: 2.1 time: 0.097063 Sep 09 01:51:32.363763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 264/493] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:32 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:32.382238 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cbb17999-9436-437d-b83b-c4ba78a58715 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 204 len: 0 microversion: 2.1 time: 0.137688 Sep 09 01:51:32.382809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 230/494] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:51:32 2022] DELETE /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:51:32.391299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:32.391908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:32.397932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.398411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.398841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.399521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:32.399970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:32.400402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:32.544345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:32.552282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5d40f447-e8f4-4a16-96c0-f88f1244c463 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1503 microversion: 2.1 time: 0.165293 Sep 09 01:51:32.552920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 265/495] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:32 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:33.387624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:33.388483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:33.395018 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:33.395505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:33.395937 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:33.396742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:33.397082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:33.397542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:33.461644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:33.470114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1cd46c28-0cc0-4168-bcdb-95722e096a2e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1305 microversion: 2.1 time: 0.087195 Sep 09 01:51:33.473105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 231/496] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:33 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:33.575931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:33.576568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:33.585799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:33.586286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:33.586712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:33.587393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:33.587902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:33.588330 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:33.726603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:33.734720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fbdb1e73-494e-450d-82bd-76dab50cc579 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1503 microversion: 2.1 time: 0.162489 Sep 09 01:51:33.735299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 266/497] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:33 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:34.493548 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:34.494281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:34.501584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:34.502151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:34.502670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:34.503475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:34.504000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:34.504499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:34.595073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:34.602874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7469b607-19f1-4fd4-9d98-79db5179cd55 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1303 microversion: 2.1 time: 0.113272 Sep 09 01:51:34.603455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 232/498] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:34 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:34.758486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:34.759031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:34.765488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:34.765964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:34.766388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:34.767068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:34.767511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:34.767923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:34.969015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:34.976981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-660096e1-0314-47cd-a92e-6789d273ee30 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1503 microversion: 2.1 time: 0.222674 Sep 09 01:51:34.977844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 267/499] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:34 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:35.626261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:35.626868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:35.633525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:35.634449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:35.634890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:35.635784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:35.636247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:35.636669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:35.788486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:35.792710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:35.799679 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-11bfdd18-b2c9-484d-b1a3-fd46659a9a8c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1303 microversion: 2.1 time: 0.177146 Sep 09 01:51:35.813086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 233/500] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:35 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:36.000128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:36.000741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:36.008413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:36.009679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:36.010121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:36.010826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:36.013773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:36.015005 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:36.123836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:36.132651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-54056e71-f3a9-4aa9-8e60-09f352fc0251 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1461 microversion: 2.1 time: 0.136582 Sep 09 01:51:36.138180 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6098281-5bcd-455f-ba61-e670588fb887", "name": "network-vif-deleted", "tag": "60493554-0ebf-41c9-9de1-47644343d2db"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:36.145427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 268/501] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:35 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1461 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:36.155288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:36.156565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:36.157261 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:36.170058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] Creating event network-vif-deleted:60493554-0ebf-41c9-9de1-47644343d2db for instance c6098281-5bcd-455f-ba61-e670588fb887 on hv-cinder-85221 Sep 09 01:51:36.176686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-8c8ce67f-cf70-427c-aa04-6340e37aef1d req-182955a6-2d7d-4054-b6c7-06afd7ed2988 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042098 Sep 09 01:51:36.177744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 234/502] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:36.823798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:36.826128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:36.832205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:36.832788 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:36.833318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:36.834076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:36.834616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:36.835104 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:37.058031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:37.065680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-33d69174-6f6c-4b22-a496-5cd35c391bce tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.245692 Sep 09 01:51:37.066248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 269/503] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:36 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:37.173016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:37.174791 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:37.180552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:37.181033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:37.181517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:37.182203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:37.182648 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:37.183069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:37.216574 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:37.217051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:37.217499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:37.217930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lazy-loading 'fault' on Instance uuid c6098281-5bcd-455f-ba61-e670588fb887 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:51:37.275372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f366d6ae3b4404f9fa4343913f67998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e0c857a31147f8afe25e68cc3e9f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:37.283240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-575f88d1-ac63-4dff-9969-e40d7076ab84 tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 200 len: 1304 microversion: 2.1 time: 0.115608 Sep 09 01:51:37.284023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 235/504] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:37 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:38.087897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:38.088404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:38.094952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:38.095439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:38.095874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:38.096558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:38.097015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:38.097467 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:38.197149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:38.208816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:38.209514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:38.210120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:38.225264 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] Creating event network-changed:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:51:38.230565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-dc26c473-128f-49a2-9ade-81f370c64ec2 req-0cc5660f-7716-4ee5-aac4-7bdf4e9f70ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037397 Sep 09 01:51:38.231551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 236/505] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:51:38.280814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:38.290888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-53d96959-6622-4aaf-badf-7214afa37125 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.207019 Sep 09 01:51:38.291461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 270/506] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:38 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:38.306844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:38.307544 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] [instance: c6098281-5bcd-455f-ba61-e670588fb887] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:38.313778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:38.314274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:38.314847 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:38.315596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:38.316050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:38.316467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:38.330780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] HTTP exception thrown: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Request method failure captured: Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 HTTP/1.1 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvBQ4X3lNroFbtkz_w2_kgntQ2h9p4G0YWSwKkN4BrET3VbC23zjsl6gkZWDHTRZ1KdEje6zSsAqKvAFfdYfAjnVCN_mR8EGshENkAPdc9inqPfY-MR60fPvVfC8OyDVzOU6siUdptbKyg7jzGOKy3tiVd5Gn2LIua1igvpNXEJIMo Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: f4e0c857a31147f8afe25e68cc3e9f24 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:51:38.332412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4e0c857a31147f8afe25e68cc3e9f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4e0c857a31147f8afe25e68cc3e9f24", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: f4e0c857a31147f8afe25e68cc3e9f24 Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesActionsTest-1495466188 Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesActionsTest-1495466188-project Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 6f366d6ae3b4404f9fa4343913f67998 Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesActionsTest-1495466188-project Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. Sep 09 01:51:38.334026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'c6098281-5bcd-455f-ba61-e670588fb887'} Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:51:38.334955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. Sep 09 01:51:38.336304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:51:38.338289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] Returning 404 to user: Instance c6098281-5bcd-455f-ba61-e670588fb887 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:51:38.339454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-71581b1d-8d73-456f-b91f-2030c9fb81bf tempest-VolumesActionsTest-1495466188 tempest-VolumesActionsTest-1495466188-project] 10.222.0.15 "GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887" status: 404 len: 111 microversion: 2.1 time: 0.036718 Sep 09 01:51:38.339979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 237/507] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:38 2022] GET /compute/v2.1/servers/c6098281-5bcd-455f-ba61-e670588fb887 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:51:39.313177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:39.313716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:39.319675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:39.320158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:39.320589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:39.321302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:39.321760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:39.322179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:39.462849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:39.471016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1395f91f-efdd-4c9b-8b80-cb19fd34dcaa tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.161777 Sep 09 01:51:39.471579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 271/508] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:39 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:40.494323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:40.494922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:40.497591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:40.503523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:40.503998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:40.504424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:40.505117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:40.505566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:40.505980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:40.640318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:40.648230 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c1758786-484d-44ed-b6da-5332e3dac732 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.157632 Sep 09 01:51:40.648807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 238/509] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:40 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:41.672006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:41.673322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:41.676160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:41.677313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=10 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:41.681923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:41.682401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:41.682826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:41.683514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:41.683961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:41.684380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:41.911301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:41.924761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-da6b97ea-8534-4437-9a4c-389f6d32ad57 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.257144 Sep 09 01:51:41.925714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 272/510] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:41 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:42.947698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:42.948298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:42.955745 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:42.956220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:42.956649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:42.957358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:42.957813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:42.958243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:43.094093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:43.101607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1287f2e6-c98e-4118-ad87-3c667ba9a47f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.157786 Sep 09 01:51:43.102158 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 239/511] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:42 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:43.842594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "name": "network-vif-plugged", "status": "completed", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:43.852434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:43.852915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:43.853579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:43.865503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] Creating event network-vif-plugged:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:51:43.870419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-021b54b3-74ee-411b-a55b-c22e2bbfe9a7 req-0ef5623b-587e-4c22-9770-8b7be3dcd06d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Sep 09 01:51:43.871292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 273/512] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:44.128573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:44.129827 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:44.138092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:44.138687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:44.139835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:44.140627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:44.141467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:44.141889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:44.272379 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:44.280890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-09ec548c-b303-4c67-9581-3aca654b9089 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.159827 Sep 09 01:51:44.281473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 240/513] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:44 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:51:45.307080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:45.307880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:45.314382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:45.314895 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:45.315354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:45.316041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:45.316486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:45.316900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:45.457050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:45.465646 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4088f54-da84-4b3c-9740-bbac5fd8da8d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.162782 Sep 09 01:51:45.466263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 274/514] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:45 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:46.488650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:46.489446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:46.496146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:46.496516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:46.496955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:46.497772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:46.498227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:46.498688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:46.636186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:46.644608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-461ce82e-ee69-43a3-b96b-df504ba8907e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1371 microversion: 2.1 time: 0.159899 Sep 09 01:51:46.645192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 241/515] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:46 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:47.667915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:47.668516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:47.675037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:47.675545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:47.676194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:47.676637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:47.677108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:47.677532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:47.696046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:51:47.811352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:51:47.819721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2faeec0a-8fb7-4155-816e-519be95645ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1564 microversion: 2.1 time: 0.155277 Sep 09 01:51:47.820115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 275/516] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:51:47 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:51:47.844045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:51:47.844498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:51:47.850899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:47.851392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:47.851831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:47.852525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:47.852984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:47.853452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:47.933588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b49a5294-f66f-4ed9-8fcd-e172468fa9bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094028 Sep 09 01:51:47.934182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 242/517] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:51:47 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:51:48.850780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:51:48.860855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:51:48.861363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:51:48.861794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:51:48.872996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] Creating event network-changed:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:51:48.878500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-5aa0b9dd-2f92-41ca-a076-70b6590a4ef9 req-58f191f7-71f7-48da-9e49-1b47b5d172c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Sep 09 01:51:48.879096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 276/518] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:08.150318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:08.151835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=42 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:08.156933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:08.157549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:08.165772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:08.166406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:08.166903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:08.167669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:08.168186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:08.168824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:08.200745 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b87e793b-9e8d-4d03-9816-7ce9f2bbb347 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/ips" status: 200 len: 146 microversion: 2.1 time: 0.052888 Sep 09 01:52:08.201742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 243/519] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:52:08 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:13.418870 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5575fb8e-a6d3-44e1-8524-2fc33c6e6196"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:13.422403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:13.430247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:13.431306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=4 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:13.434483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:13.435334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:13.435987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:13.437495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:13.438027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:13.438515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:13.779354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e835da9b-01e3-4564-897a-b414647add9d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364811 Sep 09 01:52:13.781248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 277/520] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:52:13 2022] POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:15.180867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1970236640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785472344", "security_groups": [{"name": "tempest-secgroup-smoke-1748851516"}], "block_device_mapping_v2": [{"uuid": "946d871e-f253-42e5-b19a-2611e41ed61f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:15.303188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] validate_networks() for [('eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:52:15.709076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:52:15.709509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:52:15.709983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:52:15.710392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:52:15.710804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:52:15.721208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:15.721702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:15.722144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:15.722878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:15.723336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:15.723761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:15.741569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:52:15.748890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for user fa5465b818f34778a1d51278653488ed and project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:52:15.811646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:52:15.813912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='946d871e-f253-42e5-b19a-2611e41ed61f',volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:52:16.024870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1ddf9ba3-7d6c-4bf1-aff6-a2bf7894628d tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.847919 Sep 09 01:52:16.025889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 244/521] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:52:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:52:16.038709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fa1010ca-73c8-43e0-bf1e-bff4c6221afa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:16.039359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fa1010ca-73c8-43e0-bf1e-bff4c6221afa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:16.121000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa1010ca-73c8-43e0-bf1e-bff4c6221afa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:16.130493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fa1010ca-73c8-43e0-bf1e-bff4c6221afa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1094 microversion: 2.1 time: 0.095908 Sep 09 01:52:16.131796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 278/522] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:16 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:17.154181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:17.154878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:17.162374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:17.162866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:17.163302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:17.164610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:17.164610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:17.164848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:17.230395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:17.239582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0ca05f53-1fac-4f98-934e-edc825141baa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1192 microversion: 2.1 time: 0.089761 Sep 09 01:52:17.240403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 245/523] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:17 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:18.262872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:18.263479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:18.270265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:18.270878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:18.271725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:18.272449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:18.273102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:18.273352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:18.344525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:18.352439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7bdaeb06-ef90-412d-8ba2-91c554f42edb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1210 microversion: 2.1 time: 0.093333 Sep 09 01:52:18.352980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 279/524] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:18 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:19.375839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:19.377045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:19.383426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:19.383912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:19.384340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:19.385029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:19.385510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:19.385933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:19.591422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:19.602737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-83b2fefa-be81-4bef-a2b4-fe0bc7284179 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1278 microversion: 2.1 time: 0.230736 Sep 09 01:52:19.603473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 246/525] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:19 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:19.699387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65605f6-ff2d-4119-94d5-1c1af235ce41", "tag": "c9baef20-a174-40c1-8e60-d25d6a026de4"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:19.712224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:19.712688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:19.713141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:19.724116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] Creating event network-changed:c9baef20-a174-40c1-8e60-d25d6a026de4 for instance c65605f6-ff2d-4119-94d5-1c1af235ce41 on hv-cinder-85221 Sep 09 01:52:19.728898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-89e1a09e-ae8a-41b0-b3d5-52b52806ff2e req-7bdb461c-9f8f-4f10-8ba2-dbe40f6a7346 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037750 Sep 09 01:52:19.729687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 280/526] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:20.626305 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:20.626924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:20.633940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:20.634431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:20.634901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:20.635604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:20.636077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:20.636485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:20.841349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:20.850894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-67843148-a24b-4ff7-b4fb-1d2e7f4b6c0f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1278 microversion: 2.1 time: 0.229202 Sep 09 01:52:20.851743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 247/527] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:20 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:21.392508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:21.402006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:21.402599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:21.404415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:21.509823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Going to try to stop instance {{(pid=126895) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 01:52:21.558052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-28ad514d-a8e3-42b4-ac2d-eea1fa3d9f03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action" status: 202 len: 0 microversion: 2.1 time: 0.170918 Sep 09 01:52:21.559500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 281/528] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:52:21 2022] POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:52:21.567251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:21.568046 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:21.574474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:21.574990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:21.575589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:21.576318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:21.576851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:21.577436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:21.746170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:21.756936 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-00a1908e-2e75-4cce-8d69-5af655e33a30 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.193506 Sep 09 01:52:21.757792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 248/529] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:21 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:21.875191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:21.875936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:21.882687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:21.883313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:21.884087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:21.885123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:21.885724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:21.886161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:22.095411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:22.103425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-821b3455-76d3-4f2f-bfe4-729046b707fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1278 microversion: 2.1 time: 0.232777 Sep 09 01:52:22.104417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 282/530] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:21 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:22.780705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:22.781436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:22.788048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:22.788591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:22.789031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:22.789750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:22.790206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:22.790628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:22.971082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:22.980321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d3070dd7-afa1-4e4b-b5b1-afe3c3128daf tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.204346 Sep 09 01:52:22.981374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 249/531] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:22 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:23.127367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:23.128640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:23.136669 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:23.137356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:23.137793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:23.138566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:23.139084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:23.139505 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:23.294330 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:23.302908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-624b0d70-c40f-4359-9dd5-79bca1360f61 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.180188 Sep 09 01:52:23.303503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 283/532] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:23 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:24.007371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:24.008195 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:24.014242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:24.014731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:24.015165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:24.015865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:24.016328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:24.016773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:24.164276 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:24.173370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6712477f-8b30-4deb-97f8-1e3e9bf46752 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.172714 Sep 09 01:52:24.173961 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 250/533] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:23 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:24.327514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:24.328143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:24.334933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:24.335421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:24.336058 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:24.336918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:24.337689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:24.338360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:24.496965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:24.513351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-139bec6e-c7c1-4b32-9291-9433b2674de0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.190025 Sep 09 01:52:24.515861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 284/534] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:24 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:25.198092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:25.198843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:25.205774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:25.206432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:25.206961 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:25.207915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:25.208464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:25.208980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:25.386946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:25.399442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c4c48209-e5e3-4d97-93db-87f377ec4009 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.205419 Sep 09 01:52:25.416101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 251/535] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:25 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:25.537927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:25.538611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:25.546617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:25.547128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:25.547680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:25.548408 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:25.548972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:25.549415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:25.691254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:25.702257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-440f05a0-b3b1-40ea-a886-60eeef42a16b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.168144 Sep 09 01:52:25.702838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 285/536] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:25 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:26.423966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:26.424577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:26.426451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:26.427672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:26.433376 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:26.434220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:26.435385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:26.438477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:26.439229 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:26.440253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:26.609832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:26.619397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4df1e6ed-56f7-4fe5-878a-5215ea8bceec tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.199944 Sep 09 01:52:26.620590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 252/537] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:26 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:26.725529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:26.728986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:26.733979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:26.759997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:26.760863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:26.761520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:26.762630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:26.766866 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:26.767520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:27.007896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:27.025860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-01bf63f0-b3e9-49f7-9bfd-57ebe6adab42 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.304024 Sep 09 01:52:27.026614 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 286/538] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:26 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:27.648792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:27.650150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:27.660174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:27.660462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:27.661278 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:27.662413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:27.663275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:27.663690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:27.872565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:27.887660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-743db796-1c22-4142-8a51-7b066a22bf74 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.245223 Sep 09 01:52:27.888244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 253/539] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:27 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:28.050222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:28.051071 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:28.058104 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:28.058725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:28.059719 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:28.061051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:28.061628 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:28.062142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:28.269624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:28.282856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0eb9dae8-8d1d-4198-b4b9-08c98a711230 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.234575 Sep 09 01:52:28.283453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 287/540] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:28 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:28.916824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:28.918226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:28.925885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:28.926751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:28.927349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:28.928213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:28.929006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:28.929639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:29.108411 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:29.117187 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a2ac1787-0345-4f31-a9b8-da0c304e84e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.205724 Sep 09 01:52:29.118092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 254/541] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:28 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:29.309012 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:29.309654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:29.322729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:29.323507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:29.327069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:29.327995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:29.328628 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:29.329231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:29.589498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:29.598481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-94bb65d1-136a-4cd5-a913-1d1560398393 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.294187 Sep 09 01:52:29.599076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 288/542] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:29 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:30.149842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:30.151723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:30.174193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:30.176023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:30.176755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:30.180239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:30.182547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:30.182990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:30.425249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:30.438375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0e525ab4-e447-4f76-9924-0281ffb09f0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.299750 Sep 09 01:52:30.439470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 255/543] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:30 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:30.624591 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:30.625366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:30.636006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:30.636596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:30.638246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:30.639383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:30.639949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:30.640430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:31.164411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:31.174493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-78148edf-5726-49dc-96e7-ef83565ab746 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.556725 Sep 09 01:52:31.177818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 289/544] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:30 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:31.463083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:31.463880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:31.470323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:31.479437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:31.480017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:31.480861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:31.481456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:31.482907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:31.707271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:31.734957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-84d9fd07-0b1f-490b-a1b2-bbac1782ac04 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.275092 Sep 09 01:52:31.736373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 256/545] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:31 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:32.199439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:32.199992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:32.216055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:32.217144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:32.217590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:32.218309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:32.218780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:32.219196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:32.448258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:32.463325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9b2ffb37-4801-42f0-a9e1-3a3aeb405b37 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.261730 Sep 09 01:52:32.464036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 290/546] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:32 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:32.764231 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:32.764858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:32.775324 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:32.776202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:32.776638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:32.784478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:32.785298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:32.785686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:33.190031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:33.200005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-70030f90-8c8a-4755-8b64-449991dd28a6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.439788 Sep 09 01:52:33.201576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 257/547] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:32 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:33.252449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65605f6-ff2d-4119-94d5-1c1af235ce41", "name": "network-vif-plugged", "status": "completed", "tag": "c9baef20-a174-40c1-8e60-d25d6a026de4"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:33.270383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:33.270861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:33.271282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:33.283441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] Creating event network-vif-plugged:c9baef20-a174-40c1-8e60-d25d6a026de4 for instance c65605f6-ff2d-4119-94d5-1c1af235ce41 on hv-cinder-85221 Sep 09 01:52:33.289033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-81b7d247-dbca-48f7-8900-43437088c5bb req-ac24b460-fd98-49d4-9286-79c2168c158f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040856 Sep 09 01:52:33.290184 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 291/548] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:33.503461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:33.507149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:33.520332 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:33.520888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:33.521379 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:33.522364 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:33.522924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:33.523346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:33.845702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:33.854945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-81b5eeab-72e5-4636-bcac-ee784ab96ca3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.369691 Sep 09 01:52:33.871587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 258/549] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:33 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:34.230345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:34.230987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:34.239714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:34.240096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:34.240752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:34.242008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:34.242674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:34.243348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:34.432326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:34.442582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f8b24e6c-0d36-47f5-a120-b205ac739ad8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.222189 Sep 09 01:52:34.443164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 292/550] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:34 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:34.730898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-00b5f98b-15d3-409d-acb3-2f2cb5e87829 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Action: 'create', calling method: .version_select at 0x7f87d86cd040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1621572188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALKc6tke/4MEaFBg40nZdwmI+rwywTZsjKki6bCxL7WOk61gm8gIS/DGUjwoFlaTYAwOvuU+VGYeUK4NfcEqcQEXDnNw8o20GdkSZZTwVGIRrEq8SaHIncMYFPqFLwdcQ=="}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:34.751250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-00b5f98b-15d3-409d-acb3-2f2cb5e87829 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Getting quotas for project 550fb18df8234f6cb7d5fdf9770ce11e. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:52:34.755904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-00b5f98b-15d3-409d-acb3-2f2cb5e87829 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Getting quotas for user c9efeb413ec245cfb83821f6b3433bbe and project 550fb18df8234f6cb7d5fdf9770ce11e. Resources: {'key_pairs'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:52:34.782851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-00b5f98b-15d3-409d-acb3-2f2cb5e87829 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.343418 Sep 09 01:52:34.783708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 259/551] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:52:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:34.879560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:34.880742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:34.888022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:34.889473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:34.890070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:34.901685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:34.902752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:34.903511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:34.936389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:35.166476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:35.174604 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d539efce-7d30-409e-aa03-36b8914eb838 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1266 microversion: 2.1 time: 0.299444 Sep 09 01:52:35.185945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 293/552] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:34 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:35.465633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:35.466387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:35.481000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:35.485587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:35.486323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:35.487286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:35.487908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:35.488972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:35.692488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:35.701975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-73a15bea-785e-47bf-a906-9d9ce5806a64 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.240116 Sep 09 01:52:35.713468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 260/553] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:35 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:36.202245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:36.202245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:36.218273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.219813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.221122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.226036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.226771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.228128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.380872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:36.390675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6b98f649-a873-4c2b-9e4b-badfb2eb990b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1453 microversion: 2.1 time: 0.194694 Sep 09 01:52:36.391341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 294/554] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:36 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:36.413955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:36.414671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:36.427013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.428223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.428673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.429484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.431729 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.432529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.456650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:36.606079 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:36.621007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-368a6aea-a685-4905-b8ad-b3c1bbbeeb01 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1453 microversion: 2.1 time: 0.210423 Sep 09 01:52:36.622962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 261/555] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:36 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:36.742497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:36.743235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:36.750633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.751195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.751746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.752516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:36.752974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:36.753423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:36.943775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:36.953992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-96951be7-30d6-4d60-a327-d1baec16c053 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1723 microversion: 2.1 time: 0.216313 Sep 09 01:52:36.954957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 295/556] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:36 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:37.894558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1826030697", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "networks": [{"uuid": "49f486cd-4478-435b-a6ca-c49d4acb7c74"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:37.979446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:37.980295 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] validate_networks() for [('49f486cd-4478-435b-a6ca-c49d4acb7c74', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:52:37.981185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:37.993464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:37.994343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:37.994994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:37.996214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:37.996896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:37.998187 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:38.603885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:38.613632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7dec5f64-cbbd-49b4-878f-3c3fc44eca69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1700 microversion: 2.1 time: 0.639308 Sep 09 01:52:38.615102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 296/557] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:37 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1700 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:38.645669 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:38.660214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:38.661203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:38.661924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:38.692270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Going to try to start instance {{(pid=126895) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 01:52:38.750067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9d0541cd-08d4-4c14-b011-5fd62a46081e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action" status: 202 len: 0 microversion: 2.1 time: 0.109983 Sep 09 01:52:38.751156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 297/558] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:52:38 2022] POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 01:52:38.765410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:38.766825 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:38.774985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:38.776021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:38.776557 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:38.777655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:38.778202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:38.778938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:39.256894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:39.266083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-58767ee9-9c39-469a-87cf-f0e186b492b8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1709 microversion: 2.1 time: 0.509788 Sep 09 01:52:39.266676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 298/559] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:38 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1709 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:39.267962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:52:39.268455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:52:39.269613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:52:39.270060 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:52:39.270471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:52:39.272903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:39.282621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65605f6-ff2d-4119-94d5-1c1af235ce41", "tag": "c9baef20-a174-40c1-8e60-d25d6a026de4"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:39.294475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:39.295063 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:39.295610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:39.296505 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:39.300547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:39.302086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:39.303154 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:39.303796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:39.304438 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:39.311864 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] Creating event network-changed:c9baef20-a174-40c1-8e60-d25d6a026de4 for instance c65605f6-ff2d-4119-94d5-1c1af235ce41 on hv-cinder-85221 Sep 09 01:52:39.325248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-52bee589-e7df-4027-9b09-7f5286eb9009 req-649f9b3c-d248-4879-8487-a6668d10a2e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053880 Sep 09 01:52:39.326552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 299/560] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:39.337306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Getting quotas for project bf6eb96014394a1bbd7838dc2eb03c13. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:52:39.342839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Getting quotas for user efef230f10394d5eb31976cd0d693eda and project bf6eb96014394a1bbd7838dc2eb03c13. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:52:39.360899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:52:39.365289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:52:39.430721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-81ab61e8-ec1d-442f-8cf4-c630def02ea6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551798 Sep 09 01:52:39.432118 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 262/561] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:52:39.446646 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a8c23d46-39af-4ff0-be6b-a518cdc176b0 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:39.447715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a8c23d46-39af-4ff0-be6b-a518cdc176b0 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:39.579575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a8c23d46-39af-4ff0-be6b-a518cdc176b0 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:39.588063 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a8c23d46-39af-4ff0-be6b-a518cdc176b0 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1219 microversion: 2.1 time: 0.147768 Sep 09 01:52:39.589653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 300/562] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:39 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:40.295212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:40.295828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:40.303434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:40.304168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:40.304616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:40.305482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:40.306570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:40.307068 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:40.466904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:40.475331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-88fbfdc1-d622-4318-9495-c92a48a24bae tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1709 microversion: 2.1 time: 0.185961 Sep 09 01:52:40.475899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 263/563] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:40 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:40.613959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:40.615022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:40.622479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:40.623135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:40.623665 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:40.625128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:40.625856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:40.626546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:40.714784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:40.723857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1c910f20-03e7-481e-bbf3-aa0bae21bcf4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1215 microversion: 2.1 time: 0.115743 Sep 09 01:52:40.724648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 301/564] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:40 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:41.499497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:41.500020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:41.506362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:41.506840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:41.507270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:41.507955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:41.508404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:41.508823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:41.639095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:41.647647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-03c7357d-b3d7-4688-ac32-ed73f239bc0a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1709 microversion: 2.1 time: 0.152291 Sep 09 01:52:41.648213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 264/565] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:41 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:41.748064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:41.748674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:41.756113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:41.756521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:41.756952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:41.757696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:41.758167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:41.758619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:41.828421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:41.836188 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b6ce03fd-f322-4939-a5b3-f7b5db8eda45 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1271 microversion: 2.1 time: 0.092342 Sep 09 01:52:41.836764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 302/566] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:41 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:42.672258 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:42.672916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:42.681429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:42.682006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:42.682661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:42.683891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:42.684520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:42.685741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:42.858595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:42.859217 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:42.865598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:42.866081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:42.866513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:42.867202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:42.867656 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:42.868076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:42.888749 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:42.904566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-65aa3318-3f53-44ad-8cae-5130f556fda8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1713 microversion: 2.1 time: 0.236712 Sep 09 01:52:42.920954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 265/567] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:42 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1713 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:42.956303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:42.963845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a5c9ffd3-acfc-4c1f-9c6d-3a76f9b5a9f5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1277 microversion: 2.1 time: 0.109092 Sep 09 01:52:42.964400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 303/568] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:42 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:52:43.987393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:43.988082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:43.994719 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:43.995530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:43.996041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:43.996789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:43.997322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:43.997809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:44.206104 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64db2e0-b168-4c13-88ce-8219568d1aab", "tag": "74fe8ab2-5eb4-464f-a1cf-d87619958612"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:44.211073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:44.214659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=59 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:44.226263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:44.226708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-081896f5-bb19-4658-bf03-393d5e0fdcf5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.243038 Sep 09 01:52:44.226795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:44.227164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:44.241306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] Creating event network-changed:74fe8ab2-5eb4-464f-a1cf-d87619958612 for instance d64db2e0-b168-4c13-88ce-8219568d1aab on hv-cinder-85221 Sep 09 01:52:44.242098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 266/569] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:43 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:44.254778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-a8d2f874-0521-4ce2-bdc1-df7b6b9169e1 req-ce4c15cc-e891-4915-9f19-d208efbc0fc9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052581 Sep 09 01:52:44.255392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 304/570] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:45.250892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:45.251407 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:45.257906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:45.258375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:45.258798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:45.259467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:45.259958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:45.260373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:45.394900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:45.402733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-787f389b-7f71-4988-abe1-37d69193315f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.155688 Sep 09 01:52:45.403315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 267/571] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:45 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:46.426290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:46.426979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:46.433587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:46.434064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:46.434977 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:46.435659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:46.436128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:46.436539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:46.572942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:46.580999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ef45f58a-6603-4ff3-9072-3e0b648183c6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.158757 Sep 09 01:52:46.581608 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 305/572] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:46 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:47.603558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:47.604177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:47.611107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:47.611594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:47.612028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:47.612716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:47.613241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:47.613670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:47.739211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:47.746997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-85b7489e-bf33-4e7c-ba99-6d772125ca2f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.147258 Sep 09 01:52:47.748175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 268/573] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:47 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:48.770461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:48.771063 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:48.777745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:48.778221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:48.779158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:48.779835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:48.780277 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:48.780688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:48.908435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:48.916116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b4b7e734-9f94-4e7e-9306-9a21b2fd86a4 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.149395 Sep 09 01:52:48.916691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 306/574] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:48 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:49.940605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:49.941500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:49.943775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:49.944430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=10 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:49.950535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:49.951009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:49.951441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:49.952118 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:49.952594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:49.953136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:50.082975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:50.090397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9e677696-6cac-491e-8acb-a7e5b7a3da09 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.154764 Sep 09 01:52:50.090960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 269/575] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:49 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:50.625385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64db2e0-b168-4c13-88ce-8219568d1aab", "name": "network-vif-plugged", "status": "completed", "tag": "74fe8ab2-5eb4-464f-a1cf-d87619958612"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:52:50.630227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:52:50.636550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:50.637027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:50.637472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:50.649024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] Creating event network-vif-plugged:74fe8ab2-5eb4-464f-a1cf-d87619958612 for instance d64db2e0-b168-4c13-88ce-8219568d1aab on hv-cinder-85221 Sep 09 01:52:50.654658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-b4e5225e-6883-4668-bc17-d2c0a7ad4f61 req-5a86787c-bef5-4797-8b2c-1a1388ecbc10 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Sep 09 01:52:50.655291 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 307/576] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:52:51.112341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:51.112990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:51.119319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:51.119793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:51.120476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:51.121182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:51.121630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:51.122066 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:51.252254 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:51.259686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9a6646e9-882c-44c7-a79f-a3c3ce0dd6ee tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.151256 Sep 09 01:52:51.260243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 270/577] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:51 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:52.284485 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:52.285136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:52.291250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:52.291732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:52.292167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:52.292850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:52.293424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:52.293851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:52.420797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:52.428429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-387af66c-b1e4-4d58-9e3e-6cd810fef70a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1319 microversion: 2.1 time: 0.148714 Sep 09 01:52:52.428989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 308/578] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:52 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:52:53.451690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:52:53.452294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:52:53.458717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:53.459201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:53.459632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:53.460316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:52:53.460766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:52:53.461223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:52:53.592895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:52:53.602135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3a0567e1-74ce-4e0d-9ff7-695fe32cc799 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1508 microversion: 2.1 time: 0.154239 Sep 09 01:52:53.602642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 271/579] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:52:53 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:00.115021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-387325899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1621572188", "security_groups": [{"name": "tempest-secgroup-smoke-1824437320"}], "networks": [{"uuid": "09fc8282-92f6-4e6b-a01f-5c6285422226"}], "block_device_mapping_v2": [{"uuid": "33c4ee36-d67d-4aee-82ca-7b172f1e4490", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:00.232148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] validate_networks() for [('09fc8282-92f6-4e6b-a01f-5c6285422226', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:53:00.607131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:53:00.607551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:53:00.608023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:53:00.608431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:53:00.608842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:53:00.617641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:00.618119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:00.618550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:00.619268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:00.619724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:00.620416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:00.638674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Getting quotas for project 550fb18df8234f6cb7d5fdf9770ce11e. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:53:00.642961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Getting quotas for user c9efeb413ec245cfb83821f6b3433bbe and project 550fb18df8234f6cb7d5fdf9770ce11e. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:53:00.698913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:53:00.701649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33c4ee36-d67d-4aee-82ca-7b172f1e4490',volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:53:00.835941 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a6b29f88-6bfb-4c68-94a2-8d1a54796373 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724644 Sep 09 01:53:00.836574 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 309/580] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:53:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:53:00.848380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-016fc2ba-95be-462a-8cc8-fd632d4d9d21 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:00.849108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-016fc2ba-95be-462a-8cc8-fd632d4d9d21 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:00.904156 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-016fc2ba-95be-462a-8cc8-fd632d4d9d21 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:00.911446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-016fc2ba-95be-462a-8cc8-fd632d4d9d21 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1088 microversion: 2.1 time: 0.066881 Sep 09 01:53:00.912033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 272/581] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:00 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:01.935207 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:01.935816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:01.941850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:01.942330 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:01.942763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:01.943441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:01.943892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:01.944309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:02.009150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:02.017268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-71e501d0-89de-423b-8551-b842aeda3562 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1186 microversion: 2.1 time: 0.086333 Sep 09 01:53:02.017827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 310/582] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:01 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:03.041507 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:03.042183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:03.048428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:03.048992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:03.049674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:03.050446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:03.050979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:03.051466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:03.258661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:03.270697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-303dc4c0-6966-4492-b33a-130f94d783fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1272 microversion: 2.1 time: 0.233627 Sep 09 01:53:03.274169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 273/583] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:03 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:03.827817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:03.837679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:03.838158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:03.838615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:03.854719 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] Creating event network-changed:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:53:03.863443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-2978af5a-78db-4aec-9c33-a5a4aed16cc0 req-48f6726c-6623-42ef-bd89-c16541ab9699 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039177 Sep 09 01:53:03.863443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 311/584] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:53:04.297525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:04.298162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:04.304470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:04.304950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:04.305412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:04.306100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:04.306549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:04.306973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:04.443221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:04.450805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fa6c4508-9a2f-4fc6-b15e-fbac2b7189e4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.157814 Sep 09 01:53:04.451368 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 274/585] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:04 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:05.475107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:05.475795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:05.481889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:05.482366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:05.482795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:05.483464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:05.483911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:05.484328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:05.486893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:05.620636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:05.629177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8bd83a5c-6eab-41c0-9984-c87861bef51b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.158694 Sep 09 01:53:05.629876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 312/586] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:05 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:06.651563 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:06.652170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:06.659080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:06.659562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:06.659991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:06.660667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:06.661142 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:06.661559 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:06.665384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=71 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:06.793119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:06.801346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f7cde57c-152d-4bb8-b976-7cf4c83346f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.153579 Sep 09 01:53:06.801905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 275/587] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:06 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:53:07.823410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:07.824012 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:07.831027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:07.831504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:07.831932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:07.832610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:07.833071 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:07.833493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:07.968944 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:07.976702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1958db34-2634-4a3e-ab24-af0274330ae4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.157077 Sep 09 01:53:07.977317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 313/588] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:07 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:08.999441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:09.000058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:09.006548 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:09.006958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:09.007394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:09.008081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:09.008541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:09.008966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:09.134666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:09.142549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-32a157b0-06c2-439d-975e-0aec08575f08 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.146969 Sep 09 01:53:09.143117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 276/589] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:08 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:10.165125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:10.165727 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:10.172131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:10.172607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:10.173031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:10.173721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:10.174165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:10.174575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:10.534085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:10.541518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7ec8ec72-169b-43cc-b895-38ae2ac5aada tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.380201 Sep 09 01:53:10.542074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 314/590] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:10 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:11.564477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:11.565003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:11.567353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:11.568007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:11.573673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:11.574160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:11.575086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:11.575776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:11.576232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:11.576656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:11.705934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:11.713566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4fd20404-1c59-44a2-9594-f740372540ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.152983 Sep 09 01:53:11.714128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 277/591] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:11 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:12.737768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:12.738377 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:12.740204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:12.740994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:12.747817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:12.748294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:12.748724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:12.749457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:12.749904 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:12.750319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:12.883225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:12.891343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e183b916-13d7-46ab-8f46-4b061b88bf5b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.157818 Sep 09 01:53:12.891936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 315/592] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:12 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:13.914009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:13.915063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:13.922070 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:13.922566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:13.923001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:13.923694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:13.924150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:13.924570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:14.055400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:14.063622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-82508fd5-468b-4963-b261-6a9c3c329c6d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.153474 Sep 09 01:53:14.064280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 278/593] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:13 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:14.820014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:14.820538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:14.822553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:14.828144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:14.828618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:14.829041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:14.829742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:14.830272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:14.830776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:14.854375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d0297d42-419b-4aec-9ba1-2e25e795cf53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/ips" status: 200 len: 148 microversion: 2.1 time: 0.039434 Sep 09 01:53:14.854862 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 316/594] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:53:14 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:15.088380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:15.089178 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:15.095503 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:15.096001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:15.096436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:15.097263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:15.097695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:15.098122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:15.250489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:15.258154 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9400056d-3680-4940-b1ad-e172b3ab3b60 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.175142 Sep 09 01:53:15.258736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 279/595] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:15 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:16.280998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:16.281632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:16.288290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:16.288776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:16.289244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:16.289932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:16.290384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:16.290805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:16.424634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:16.432544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-59f36090-226a-478f-8ae3-806242b32f38 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.155390 Sep 09 01:53:16.433195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 317/596] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:16 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:17.320297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c237716-5256-468e-b826-f2eae74c60d8"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:17.322770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:17.329473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:17.329966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:17.330402 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:17.331106 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:17.331559 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:17.331980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:17.455588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:17.456341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:17.462551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:17.463025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:17.463621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:17.464306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:17.465358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:17.465772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:17.621086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:17.625998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-176d5db1-5f84-4898-9332-b1c2af24e4d8 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309496 Sep 09 01:53:17.626685 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 280/597] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:53:17 2022] POST /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:17.629940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aee2dd5b-0220-4772-9282-df8ac6a11f90 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.178120 Sep 09 01:53:17.631478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "name": "network-vif-plugged", "status": "completed", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:17.641643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:17.641920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 318/598] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:17 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:53:17.642286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:17.642715 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:17.658004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] Creating event network-vif-plugged:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:53:17.663143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-dc91f99b-a258-4a33-8d40-8fcc9e7b0b28 req-e08260f3-b7ca-4f7e-8475-4a4633f5ab9f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Sep 09 01:53:17.663915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 281/599] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:18.652869 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:18.653529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:18.659891 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:18.660369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:18.660799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:18.661512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:18.661963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:18.662376 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:18.791066 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:18.798693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-be6c99bb-b715-4863-bc81-8dd8cbcd968b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.149561 Sep 09 01:53:18.799258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 319/600] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:18 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:19.401623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddaaaa3d-0a5d-4366-81db-613a581d4af3", "device": "/dev/sdb"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:19.405234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:19.411137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:19.411610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:19.412031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:19.412705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:19.413183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:19.413602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:19.708854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-de794175-8c50-409a-9efa-995ee5eac10e tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "POST /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311747 Sep 09 01:53:19.709489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 282/601] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:53:19 2022] POST /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:19.820886 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:19.821527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:19.828253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:19.828868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:19.829337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:19.830040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:19.830490 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:19.830901 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:19.964129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:19.972747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4464e142-3d1f-4b85-bea9-5f9537f67e98 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1260 microversion: 2.1 time: 0.155636 Sep 09 01:53:19.973339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 320/602] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:19 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:20.997393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:20.998095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:21.004259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:21.004744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:21.005330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:21.006019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:21.006473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:21.006894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:21.140000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:21.147966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-90e5eb64-f395-40e3-a520-c2ece6054c79 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1445 microversion: 2.1 time: 0.156262 Sep 09 01:53:21.148534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 283/603] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:20 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:21.170064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:21.170675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:21.176973 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:21.177478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:21.177907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:21.178598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:21.179031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:21.179450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:21.307026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:21.315435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-559ce19b-648b-4322-943a-638564c8df30 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1445 microversion: 2.1 time: 0.149198 Sep 09 01:53:21.315995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 321/604] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:21 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:22.981205 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:22.990954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:22.991427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:22.991844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:23.003406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] Creating event network-changed:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:53:23.008598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-6e38da46-83f0-49e6-a637-71045eef3510 req-f3f15494-9152-43fc-8f25-585bcc0ea81f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030957 Sep 09 01:53:23.009393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 284/605] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:26.249463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-110c9b18-2b06-4d4e-9a0d-0292067a638f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: .version_select at 0x7f87d86feca0>, body: {"keypair": {"name": "tempest-keypair-453184586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPhdPiHXabC0vTCOZHs5wSGzrSo+vE8fejCCC/e/qwnM2R6IWgwqD7rggoGog6Colaol+b8Ln4LMV/anleZbhpXGe4aparQYXQ+Tm+onUoOTMhn+X737k/gKSLIjHztRA=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:26.264662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-110c9b18-2b06-4d4e-9a0d-0292067a638f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:53:26.268323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-110c9b18-2b06-4d4e-9a0d-0292067a638f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:53:26.289689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-110c9b18-2b06-4d4e-9a0d-0292067a638f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043940 Sep 09 01:53:26.290472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 322/606] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:53:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:27.534077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-585617192", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3840bd6e-907e-4191-be2d-5f3b8f05d0c8"}], "security_groups": [{"name": "tempest-securitygroup--1908102357"}], "key_name": "tempest-keypair-453184586", "user_data": "}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:27.733517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] validate_networks() for [('3840bd6e-907e-4191-be2d-5f3b8f05d0c8', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:53:28.109243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:53:28.109665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:53:28.110127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:53:28.110528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:53:28.110927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:53:28.119761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:28.120232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:28.121333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:28.122047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:28.122492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:28.122912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:28.138995 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:53:28.143260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:53:28.154185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:53:28.156564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:53:28.204218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1c547eac-44ee-4515-9b40-5f65b6533833 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.675230 Sep 09 01:53:28.205018 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 285/607] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:53:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 01:53:28.216402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6ca2b6a4-0c02-49ca-bcb7-293a8d9681af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:28.217006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6ca2b6a4-0c02-49ca-bcb7-293a8d9681af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:28.329698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6ca2b6a4-0c02-49ca-bcb7-293a8d9681af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:28.337282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6ca2b6a4-0c02-49ca-bcb7-293a8d9681af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1240 microversion: 2.1 time: 0.125261 Sep 09 01:53:28.337945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 323/608] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:28 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:29.361014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:29.361649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:29.368387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:29.368871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:29.369339 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:29.370331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:29.370788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:29.371210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:29.438489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:29.447034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e65569aa-865c-476b-9843-7c6ec2338cb6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1292 microversion: 2.1 time: 0.090269 Sep 09 01:53:29.447592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 286/609] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:29 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:30.472445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:30.473430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:30.483358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:30.487810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:30.488669 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:30.489798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:30.490542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:30.491263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:30.701243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:30.709532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d7995d82-eae6-47ec-b0b6-17166d58d390 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.242691 Sep 09 01:53:30.710190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 324/610] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:30 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:31.298013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f2946f-79f7-4ccb-91df-7125a9e02ad4", "tag": "6022e8ff-02ea-4658-8b51-6f209d25406d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:31.307702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:31.308712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:31.309163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:31.320375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] Creating event network-changed:6022e8ff-02ea-4658-8b51-6f209d25406d for instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 on hv-cinder-85221 Sep 09 01:53:31.325207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-025ee8f4-3ee6-4503-8560-2dea022f61e9 req-defb4108-6f68-413b-9630-8f0590e4b602 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Sep 09 01:53:31.325970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 287/611] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:31.733315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:31.733940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:31.740505 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:31.741041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:31.741564 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:31.742216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:31.742698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:31.743115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:31.944263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:31.952263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3ef49ec9-3c02-4744-929e-b184abf0a010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.223505 Sep 09 01:53:31.952820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 325/612] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:31 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:32.975819 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:32.976735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:32.982875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:32.983359 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:32.983796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:32.984493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:32.984949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:32.985401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:33.284694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:33.292350 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-048fb57e-2d33-40d6-9b57-0b4f873ef9ba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.321228 Sep 09 01:53:33.292917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 288/613] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:32 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:34.315254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:34.315889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:34.322226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:34.322712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:34.323189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:34.323868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:34.324320 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:34.324738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:34.454997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:34.462513 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d1100895-7acb-44ee-a693-f91e6165663b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.151263 Sep 09 01:53:34.463084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 326/614] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:34 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:35.485636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:35.486174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:35.492418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:35.492891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:35.493343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:35.494022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:35.494725 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:35.495290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:35.618252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:35.626051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1e104c9b-fbc6-483a-ba6f-04641a271335 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.144261 Sep 09 01:53:35.626613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 289/615] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:35 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:36.652495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:36.653133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:36.662877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:36.663743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:36.664514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:36.665785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:36.666610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:36.667949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:36.673496 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=76 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:36.796772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:36.804393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2710c67b-28bd-4fca-953f-b194152edc2d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.156357 Sep 09 01:53:36.804960 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 327/616] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:36 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:37.827954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:37.828554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:37.835091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:37.835560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:37.836033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:37.836753 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:37.837232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:37.837646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:37.840218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:37.974215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:37.982281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6ac59fbc-f315-4b12-a09a-ae4f04bb96f5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.159094 Sep 09 01:53:37.982830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 290/617] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:37 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:39.006760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:39.007374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:39.009668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:39.015983 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:39.016471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:39.016966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:39.017633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:39.018081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:39.018502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:39.160584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:39.168284 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-32064a2f-7d56-4639-b824-8be2380ee9c5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.165394 Sep 09 01:53:39.168841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 328/618] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:39 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:40.191156 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:40.191767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:40.193636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:40.194288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:40.201262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:40.201743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:40.202173 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:40.203252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:40.203710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:40.204131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:40.332681 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:40.340260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-75957faf-2520-40ea-ac5a-6dd399d7ea10 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.152971 Sep 09 01:53:40.340857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 291/619] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:40 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:41.364410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:41.365041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:41.371724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:41.372198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:41.372624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:41.373333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:41.373781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:41.374198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:41.500460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:41.508059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d038f31e-9918-47c6-9f0e-32fcc0730fbc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.147461 Sep 09 01:53:41.508616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 329/620] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:41 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:42.532088 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:42.532644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:42.534953 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:42.540287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:42.540770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:42.541239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:42.541929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:42.542383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:42.542806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:42.672576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:42.680240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b90e1265-2ba4-4bb9-ae89-0f717c488683 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.152254 Sep 09 01:53:42.680810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 292/621] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:42 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:43.703502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:43.704140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:43.710043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:43.710521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:43.710951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:43.711629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:43.712079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:43.712494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:43.840974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:43.848800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-01e3bfe4-3490-417a-b852-319f24b0fe9c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.149289 Sep 09 01:53:43.849408 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 330/622] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:43 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:44.872070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:44.872681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:44.876006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:53:44.879470 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:44.879955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:44.880397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:44.881160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:44.881547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:44.881978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:44.968293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ad86971-42f9-4029-a50e-b364214f136e"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:44.970731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:44.977103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:44.977733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:44.978170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:44.978880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:44.979334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:44.979751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:45.018707 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:45.030605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-498bc2e1-10e1-4003-9750-f4d3ed8471a7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.162919 Sep 09 01:53:45.031285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 331/623] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:44 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:53:46.017801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cd75b998-34df-4cb1-b363-ee657b4a5192 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.161510 Sep 09 01:53:46.018445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 293/624] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:53:44 2022] POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:53:46.053502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:46.054191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:46.060247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:46.060734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:46.061210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:46.061884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:46.062337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:46.062754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:46.196163 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:46.210780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f63f9749-26d3-4ca3-b65f-5118b1c04fa0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.161045 Sep 09 01:53:46.211341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 332/625] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:46 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:47.233682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:47.234405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:47.240951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:47.241462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:47.241896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:47.242589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:47.243042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:47.243465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:47.370531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:47.378585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7e8dfc28-a5f9-407c-b08c-035f88b6cd21 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.149119 Sep 09 01:53:47.379145 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 294/626] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:47 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:48.402528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:48.403215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:48.409601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:48.410093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:48.410530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:48.411212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:48.411663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:48.412083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:48.549642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:48.557493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3ac6cd08-8ef3-4572-9576-5f9c233f6c53 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.159456 Sep 09 01:53:48.558055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 333/627] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:48 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:49.580500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:49.581126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:49.587835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:49.588810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:49.589268 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:49.589943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:49.590394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:49.591124 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:49.718946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:49.726445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-635ad5b0-39df-40f9-801d-003e4dd2ba8e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.149690 Sep 09 01:53:49.727007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 295/628] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:49 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:50.750769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:50.751301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:50.757732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:50.758211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:50.758641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:50.759316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:50.759765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:50.760180 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:50.893259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:50.901803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-67bbdb77-6f3a-4558-a8b9-39a683ca0ea2 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.154291 Sep 09 01:53:50.902380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 334/629] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:50 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:51.923808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:51.924476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:51.930945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:51.931427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:51.931858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:51.933091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:51.933554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:51.934029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:52.066780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:52.074458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-71468a44-96c9-411b-a2e8-31dcdd65b60b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.154557 Sep 09 01:53:52.075021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 296/630] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:51 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:52.538629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f2946f-79f7-4ccb-91df-7125a9e02ad4", "name": "network-vif-plugged", "status": "completed", "tag": "6022e8ff-02ea-4658-8b51-6f209d25406d"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:52.549336 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:52.549742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:52.550182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:52.562414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] Creating event network-vif-plugged:6022e8ff-02ea-4658-8b51-6f209d25406d for instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 on hv-cinder-85221 Sep 09 01:53:52.567587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-05fb4b15-9202-40dd-8000-2a7dd1bb7576 req-96fb4682-4756-491a-afba-6964c3064b16 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032548 Sep 09 01:53:52.568235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 335/631] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:53.097353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:53.097967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:53.104285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:53.104767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:53.105236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:53.105920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:53.106375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:53.106792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:53.235388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:53.242912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c2c85d28-d68d-4470-b903-7dccb0ca7000 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.149452 Sep 09 01:53:53.243472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 297/632] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:53 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:53:54.268212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:54.268816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:54.275022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:54.275563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:54.275994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:54.277345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:54.277800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:54.278229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:54.426363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:54.433885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cd06822c-cab0-4511-80c7-e751de4ab066 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.170893 Sep 09 01:53:54.434475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 336/633] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:54 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:54.951956 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:54.952476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:54.958866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:54.959195 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:54.959632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:54.960349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:54.960805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:54.961257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:55.086935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lazy-loading 'services' on Instance uuid d64db2e0-b168-4c13-88ce-8219568d1aab {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:53:55.196943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b360694d-8bff-479d-b87a-d0aee1d9bd88 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab/os-volume_attachments/ddaaaa3d-0a5d-4366-81db-613a581d4af3" status: 202 len: 0 microversion: 2.1 time: 0.248795 Sep 09 01:53:55.197587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 298/634] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:53:54 2022] DELETE /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab/os-volume_attachments/ddaaaa3d-0a5d-4366-81db-613a581d4af3 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:53:55.456962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:55.457520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:55.464288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:55.464762 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:55.465226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:55.465901 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:55.466365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:55.466759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:55.833490 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:55.841844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2bfd6fee-e2e0-438f-881e-1c907cdfa22a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1366 microversion: 2.1 time: 0.388771 Sep 09 01:53:55.842410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 337/635] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:55 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:56.865521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:56.866144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:56.873582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:56.874063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:56.874493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:56.875174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:56.875626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:56.876051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:57.004577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:57.012220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff0ec2e0-c994-42a4-b66e-edc013158416 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1555 microversion: 2.1 time: 0.151591 Sep 09 01:53:57.012779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 299/636] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:56 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:57.034711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:57.035202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:57.041528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:57.042535 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:57.042968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:57.043657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:57.044112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:57.044531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:57.119354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b7c4f715-db37-4109-8b92-e664bc42241f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088159 Sep 09 01:53:57.119986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 338/637] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:53:57 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:58.044155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f2946f-79f7-4ccb-91df-7125a9e02ad4", "tag": "6022e8ff-02ea-4658-8b51-6f209d25406d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:58.057319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:58.059445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:58.059963 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:58.073930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] Creating event network-changed:6022e8ff-02ea-4658-8b51-6f209d25406d for instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 on hv-cinder-85221 Sep 09 01:53:58.080657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-09b77ad9-13ee-421b-b069-25c617530798 req-2effa885-7b0c-43b5-8d69-63f3c5e3de91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040480 Sep 09 01:53:58.081941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 300/638] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:53:58.839166 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:53:58.842265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:58.853975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:58.854779 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:58.855389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:58.856279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:58.856897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:58.857510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:58.888987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lazy-loading 'flavor' on Instance uuid 8cfd7b66-e9a2-4276-8121-cbef564f363f {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:53:59.033823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9b389369-e924-4e55-abca-2d34a5258318 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/action" status: 200 len: 32 microversion: 2.1 time: 0.200491 Sep 09 01:53:59.035000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 339/639] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:53:58 2022] POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 01:53:59.045924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:59.046641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:59.053972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.054534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.055883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.060688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.061260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.061704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.391024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:59.399627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-62301387-7810-4d7e-8bed-42b5aa6a8d92 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.358754 Sep 09 01:53:59.409723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 301/640] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:59 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:53:59.508859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:59.509481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:59.516115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.516533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.516957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.517663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.518281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.518701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.546674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:53:59.624142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9459e50b-14a9-4346-91c0-f6f164db203b tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 204 len: 0 microversion: 2.1 time: 0.119183 Sep 09 01:53:59.624943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 340/641] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:53:59 2022] DELETE /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:53:59.633897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:53:59.634512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:53:59.640442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.640925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.641395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.642089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:53:59.642547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:53:59.642966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:53:59.767550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:53:59.775143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-25085e91-c719-40af-8d98-3af7bf190861 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1514 microversion: 2.1 time: 0.145038 Sep 09 01:53:59.775714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 302/642] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:53:59 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:00.424547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:00.425258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:00.431447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:00.431918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:00.432916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:00.433610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:00.434058 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:00.434471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:00.436992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:00.564597 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:00.572619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8e98848f-e03d-480a-8420-07a1649aab84 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.152252 Sep 09 01:54:00.573200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 341/643] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:00 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:00.798525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:00.799086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:00.805553 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:00.806031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:00.806460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:00.807140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:00.807592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:00.808011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:00.937526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:00.945088 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1205acb0-b0e4-48e8-a56e-2e78dffec7a6 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1514 microversion: 2.1 time: 0.150461 Sep 09 01:54:00.945655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 303/644] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:00 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:01.595456 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:01.595971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:01.602561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:01.603123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:01.603560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:01.604876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:01.605354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:01.605781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:01.736858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:01.745279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-98ab363b-2696-44f0-b7ef-1fa31dbb36c1 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.153722 Sep 09 01:54:01.745855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 342/645] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:01 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:01.968981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:01.969626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:01.976053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:01.976533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:01.976962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:01.977670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:01.978119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:01.978535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:02.102096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:02.110153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-40c87eb3-7dc1-4513-8b6b-310f01b0aa0d tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1514 microversion: 2.1 time: 0.144980 Sep 09 01:54:02.110713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 304/646] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:01 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:02.699620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64db2e0-b168-4c13-88ce-8219568d1aab", "name": "network-vif-deleted", "tag": "74fe8ab2-5eb4-464f-a1cf-d87619958612"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:02.709469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:02.709938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:02.710362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:02.722295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] Creating event network-vif-deleted:74fe8ab2-5eb4-464f-a1cf-d87619958612 for instance d64db2e0-b168-4c13-88ce-8219568d1aab on hv-cinder-85221 Sep 09 01:54:02.726930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-f5ea80ee-b75c-4761-94fb-f05ed801d1d6 req-a6531229-5bfd-44c1-91d7-e03bbede0f84 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 Sep 09 01:54:02.727526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 343/647] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:54:02.767767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:02.768377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:02.774385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:02.774869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:02.775300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:02.776591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:02.777052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:02.777652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:02.792080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:02.908804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:02.917693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b4bb0a78-42b2-4f30-91ab-0237baef54f2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.153794 Sep 09 01:54:02.918269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 305/648] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:02 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:03.134668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:03.135375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:03.141659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:03.142150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:03.142582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:03.143270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:03.143721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:03.144140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:03.175416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:03.175899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:03.176328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:03.176775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lazy-loading 'fault' on Instance uuid d64db2e0-b168-4c13-88ce-8219568d1aab {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:54:03.217809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:03.225425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d523f120-05b9-45d5-8226-7a7432415ab8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 200 len: 1309 microversion: 2.1 time: 0.095208 Sep 09 01:54:03.225982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 344/649] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:03 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:03.942735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:03.943496 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:03.950323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:03.950799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:03.951247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:03.951924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:03.952371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:03.952784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:04.079887 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:04.087907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-07ab4193-228d-4124-804f-b09c29021409 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.149073 Sep 09 01:54:04.088486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 306/650] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:03 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:04.248623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:04.249270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: d64db2e0-b168-4c13-88ce-8219568d1aab] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:04.255622 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:04.256101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:04.256533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:04.257312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:04.257764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:04.258182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:04.271176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] HTTP exception thrown: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Request method failure captured: Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab HTTP/1.1 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpxj9LaVGm8A1CP1sHdTZHawB4mKplYHW3zD1EEaZD3AftTYYZjxfA5q4p_7Lt-ktrnJqyEHMlK08-4Nrz56uxtB3Fcl86SVpiY2wO7Jjwq6oVvjOIgKz-F9tSVmnZF7K94znZG11wVV5qQdN9xdaKm8jFIMfyEtYfmn3ECVE5zC4WI Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: bf6eb96014394a1bbd7838dc2eb03c13 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:54:04.272775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bf6eb96014394a1bbd7838dc2eb03c13", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: bf6eb96014394a1bbd7838dc2eb03c13 Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesSnapshotTestJSON-1195224046-project Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: efef230f10394d5eb31976cd0d693eda Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesSnapshotTestJSON-1195224046-project Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. Sep 09 01:54:04.274436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'd64db2e0-b168-4c13-88ce-8219568d1aab'} Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:54:04.275473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. Sep 09 01:54:04.276923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:04.278373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Returning 404 to user: Instance d64db2e0-b168-4c13-88ce-8219568d1aab could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:54:04.278373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0c65f25e-2c16-4dfc-a769-74c940d1948a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab" status: 404 len: 111 microversion: 2.1 time: 0.030249 Sep 09 01:54:04.278373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 345/651] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:04 2022] GET /compute/v2.1/servers/d64db2e0-b168-4c13-88ce-8219568d1aab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:54:05.111084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:05.111689 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:05.118241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:05.118732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:05.119463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:05.120150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:05.120636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:05.121137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:05.247588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:05.255658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-41f5c3e3-4aa3-4c1c-aed1-24226f7b4fc8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.148394 Sep 09 01:54:05.256226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 307/652] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:05 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:06.279013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:06.279556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:06.285897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:06.286378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:06.286807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:06.287487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:06.287938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:06.288357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:06.416612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:06.424759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8c6f29e8-524e-4e04-992f-6745858d1e9c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.150221 Sep 09 01:54:06.425343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 346/653] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:06 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:07.447724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:07.448267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:07.454586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:07.455067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:07.455495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:07.456211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:07.456664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:07.457107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:07.584508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:07.593196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2dd3b039-7bbf-4ed1-b06a-64b18baa1678 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.149414 Sep 09 01:54:07.593762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 308/654] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:07 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:08.617242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:08.617854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:08.625079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:08.625567 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:08.625997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:08.626675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:08.627125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:08.627543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:08.758050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:08.766462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c9123421-2a67-40f4-a0e4-8842a792cf72 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.153015 Sep 09 01:54:08.767030 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 347/655] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:08 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:09.789521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:09.789989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:09.796682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:09.797199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:09.797638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:09.798332 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:09.798784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:09.799204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:10.168499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:10.176637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1813ce13-15fd-4795-968a-83da69a250bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.391483 Sep 09 01:54:10.177395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 309/656] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:09 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:11.200265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:11.200902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:11.207635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:11.208121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:11.208554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:11.209266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:11.209726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:11.210147 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:11.333989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:11.342074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aeab4850-cfcb-4da8-a575-6626885a2259 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.146282 Sep 09 01:54:11.342641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 348/657] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:11 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:12.365338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:12.365960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:12.373381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:12.373870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:12.374308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:12.374995 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:12.375453 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:12.375877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:12.506934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:12.515069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-babda848-986f-46a4-a726-85511eb280c5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.153608 Sep 09 01:54:12.515632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 310/658] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:12 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:13.537971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:13.538505 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:13.544891 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:13.545401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:13.545829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:13.546501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:13.546945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:13.547358 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:13.671428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:13.679368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f0064b98-7eef-47b2-b2f7-de5324e5c209 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.145269 Sep 09 01:54:13.679949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 349/659] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:13 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:14.703181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:14.703822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:14.706134 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=38 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:14.711317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:14.711801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:14.712357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:14.713812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:14.714269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:14.714693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:14.854144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:14.862229 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-14f047c0-c0d3-4925-85ce-172cbcc054e5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.162865 Sep 09 01:54:14.862811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 311/660] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:14 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:15.885556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:15.886162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:15.888534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:15.893816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:15.894303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:15.894736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:15.895425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:15.895884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:15.896302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:16.027841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:16.035926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5ad6e558-88ac-4611-b663-ee828356859b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.154242 Sep 09 01:54:16.036493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 350/661] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:15 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:16.167582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1753500007", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "networks": [{"uuid": "49f486cd-4478-435b-a6ca-c49d4acb7c74"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:16.219873 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] validate_networks() for [('49f486cd-4478-435b-a6ca-c49d4acb7c74', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:54:16.602301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:54:16.602715 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:54:16.603842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:54:16.604276 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:54:16.604678 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:54:16.613363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:16.613832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:16.614250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:16.614961 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:16.615405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:16.615822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:16.631877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Getting quotas for project bf6eb96014394a1bbd7838dc2eb03c13. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:54:16.635728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Getting quotas for user efef230f10394d5eb31976cd0d693eda and project bf6eb96014394a1bbd7838dc2eb03c13. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:54:16.646554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:54:16.648767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:54:16.698292 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8e437cda-6091-4e51-bfb0-88675b215d74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534439 Sep 09 01:54:16.698939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 312/662] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:54:16.709897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-17750538-df16-4b06-84bb-9d1f48559a74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:16.710600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-17750538-df16-4b06-84bb-9d1f48559a74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:16.768206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-17750538-df16-4b06-84bb-9d1f48559a74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:16.775080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-17750538-df16-4b06-84bb-9d1f48559a74 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1219 microversion: 2.1 time: 0.068816 Sep 09 01:54:16.775645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 351/663] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:16 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:17.059240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:17.059885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:17.066660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:17.067242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:17.067744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:17.068510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:17.069033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:17.069569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:17.202804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:17.211014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8fccbbda-d416-4eee-b8a9-b937654062d3 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.156448 Sep 09 01:54:17.211763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 313/664] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:17 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:17.797565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:17.798109 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:17.804822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:17.805337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:17.805775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:17.806474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:17.806927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:17.807348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:17.867465 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:17.875663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-68f76de3-c16e-448d-8080-4bf44a67ded8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1271 microversion: 2.1 time: 0.081954 Sep 09 01:54:17.876224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 352/665] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:17 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:18.235732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:18.236502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:18.244796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:18.244796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:18.244796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:18.245580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:18.245757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:18.246188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:18.463666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:18.472223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8a1f0655-0a49-4da0-96ab-d506b995a8e7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.240977 Sep 09 01:54:18.472800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 314/666] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:18 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:18.897936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:18.898937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:18.905662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:18.906152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:18.906581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:18.907299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:18.907751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:18.908172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:19.096965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:19.105051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2d004c71-0755-41fd-94aa-c8facb5f6644 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.211045 Sep 09 01:54:19.105700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 353/667] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:18 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:19.495946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:19.496546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:19.502890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:19.503370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:19.503800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:19.504482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:19.504957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:19.505400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:19.696862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:19.705494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-37bd31cc-9b9e-4152-a48a-b145760a446e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.213603 Sep 09 01:54:19.706061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 315/668] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:19 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:19.774601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8529cd82-0f79-4067-bcdf-cce664cf1e21", "tag": "0fe1d40f-8ad5-411d-a904-f24754837359"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:19.783770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:19.784235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:19.784694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:19.795540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] Creating event network-changed:0fe1d40f-8ad5-411d-a904-f24754837359 for instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 on hv-cinder-85221 Sep 09 01:54:19.800229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-25d95b72-f1b8-481b-b6d7-5befa0727abe req-198ee6ce-3056-4396-941c-ccda99b1b86f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091060 Sep 09 01:54:19.800785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 354/669] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:54:20.128902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:20.129542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:20.135577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:20.136057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:20.136493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:20.137213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:20.137671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:20.138095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:20.261773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:20.269290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4f369aaa-762c-4efd-be7e-9b63a4624cd5 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.144155 Sep 09 01:54:20.269856 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 316/670] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:20 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:20.730396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:20.731085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:20.737249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:20.737724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:20.738148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:20.738816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:20.739260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:20.739672 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:20.876744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:20.885386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1f88d5ea-0d5b-418f-a602-eed699035488 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.159562 Sep 09 01:54:20.885946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 355/671] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:20 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:21.292321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:21.292869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:21.299217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:21.299698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:21.300132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:21.300824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:21.301322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:21.301742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:21.546417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:21.553960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-026e7951-18ef-4d9f-9372-799fdc08ce4a tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.266038 Sep 09 01:54:21.554523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 317/672] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:21 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:21.907685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:21.908289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:21.914744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:21.915220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:21.916172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:21.916848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:21.917324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:21.917738 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:22.045247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:22.053482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b6d27891-f3eb-4d7e-ac9a-09287b09bec2 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.149593 Sep 09 01:54:22.054051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 356/673] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:21 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:22.576968 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:22.577608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:22.583883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:22.584357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:22.584780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:22.585488 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:22.585935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:22.586348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:22.713661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:22.721909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-65b02232-06bc-4577-931f-0cbb60885732 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.148640 Sep 09 01:54:22.722521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 318/674] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:22 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:23.077245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:23.077852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:23.084489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:23.084971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:23.085435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:23.086120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:23.086565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:23.086983 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:23.289885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:23.298546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a431de78-716f-4d6c-8417-ecabbb2c8e39 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.225523 Sep 09 01:54:23.299126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 357/675] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:23 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:23.745955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:23.746554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:23.752859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:23.753377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:23.753842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:23.754524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:23.754976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:23.755395 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:23.880410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:23.888466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-38374296-096d-4227-a476-b07872b88853 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.146607 Sep 09 01:54:23.889029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 319/676] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:23 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:24.320968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:24.321688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:24.327904 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:24.328375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:24.328799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:24.329504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:24.329952 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:24.330368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:24.456392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:24.464427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b4cd44bf-7016-47dc-a4c6-5b19e8d3c74b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.147287 Sep 09 01:54:24.464982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 358/677] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:24 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:24.910670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:24.911283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:24.918420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:24.918907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:24.919363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:24.920349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:24.920807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:24.921259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:25.048312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:25.055828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-afde31f4-225d-4676-b655-75297308ae93 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.149024 Sep 09 01:54:25.056388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 320/678] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:24 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:25.488398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:25.488948 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:25.495626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:25.496112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:25.496546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:25.497271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:25.497731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:25.498155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:25.621693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:25.629739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-97d84e5b-bf69-4f21-a990-f18d6612c95f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.145306 Sep 09 01:54:25.630304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 359/679] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:25 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:26.078746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:26.079280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:26.086029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:26.086029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:26.086430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:26.087770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:26.088218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:26.088634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:26.220451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:26.228041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0e158e11-282f-4564-be19-56f23b11a5c1 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.153316 Sep 09 01:54:26.228596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 321/680] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:26 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:26.652322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:26.652933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:26.659317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:26.659798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:26.660231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:26.660911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:26.661393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:26.661814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:26.676504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:26.772763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:26.787021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:26.795605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e110491e-fc1f-4007-9083-d2adc77f1261 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1734 microversion: 2.1 time: 0.147112 Sep 09 01:54:26.796169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 360/681] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:26 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:27.251352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:27.251998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:27.253891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:27.254669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:27.261462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:27.261948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:27.262385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:27.263075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:27.263530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:27.263954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:27.391360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:27.394319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:27.401858 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-634a65d9-97fd-4b29-9452-7185f928abfb tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.154316 Sep 09 01:54:27.403165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 322/682] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:27 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:27.819713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:27.820305 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:27.826640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:27.827117 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:27.827545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:27.828215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:27.828660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:27.829087 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:27.958481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:27.967114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d7e76c13-2c71-4fb3-8832-b04b26af3231 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1714 microversion: 2.1 time: 0.151212 Sep 09 01:54:27.967679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 361/683] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:27 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:28.029418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:28.029920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:28.038418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.038418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.038844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.039551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.040193 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.040969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.096329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:28.096903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:28.104176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.104766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.105303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.106083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.106615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.107120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.170871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] HTTP exception thrown: Cannot 'detach_volume' instance 8cfd7b66-e9a2-4276-8121-cbef564f363f while it is in vm_state rescued Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Request method failure captured: Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments/6ad86971-42f9-4029-a50e-b364214f136e HTTP/1.1 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGptyaCAmKuxdV93bhtYJbYv4rqJ5x0w_r5SWUS4684TBJ2fVu57gzwqawQ42RNEFcQJL_6N3_bw5TSrLR8-6_WXuc0QhjIWtvRiq-0QBBHsBEGdt-ZGKZK-ILeom5L9geBDVm_-GlrvLOniHepN_n40swMjxeBS8UjNV_vFgqbYaD1k Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:54:28.172473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6b35000faf844d758c12de9938c235a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6b35000faf844d758c12de9938c235a8", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 3153c9ff011f4ab8958fc49795e6f8f1 Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:54:28.174077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Cannot 'detach_volume' instance 8cfd7b66-e9a2-4276-8121-cbef564f363f while it is in vm_state rescued Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'server_id': '8cfd7b66-e9a2-4276-8121-cbef564f363f', 'id': '6ad86971-42f9-4029-a50e-b364214f136e'} Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:54:28.174913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8cfd7b66-e9a2-4276-8121-cbef564f363f while it is in vm_state rescued Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8cfd7b66-e9a2-4276-8121-cbef564f363f while it is in vm_state rescued Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:54:28.176077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Returning 409 to user: Cannot 'detach_volume' instance 8cfd7b66-e9a2-4276-8121-cbef564f363f while it is in vm_state rescued {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:54:28.177008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a7ab976c-8341-4960-9d94-2fdd2510c96f tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments/6ad86971-42f9-4029-a50e-b364214f136e" status: 409 len: 152 microversion: 2.1 time: 0.149524 Sep 09 01:54:28.177008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 362/684] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:54:28 2022] DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments/6ad86971-42f9-4029-a50e-b364214f136e => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 01:54:28.183102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:28.183670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:28.191407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.192022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.192444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lazy-loading 'services' on Instance uuid 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:54:28.192754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.193827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.194493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.195292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.264589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-038f17e4-42df-46e8-af0b-f8858e907e6b tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/action" status: 202 len: 0 microversion: 2.1 time: 0.085453 Sep 09 01:54:28.265449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 363/685] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:54:28 2022] POST /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 01:54:28.268048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-47b056ad-b72e-48f8-a172-4c0e37a2615e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments/5575fb8e-a6d3-44e1-8524-2fc33c6e6196" status: 202 len: 0 microversion: 2.1 time: 0.285521 Sep 09 01:54:28.269003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 323/686] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:54:27 2022] DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments/5575fb8e-a6d3-44e1-8524-2fc33c6e6196 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:54:28.274082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:28.275394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:28.281920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.282415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.282850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.283551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.284014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.284436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.427249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:28.427951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:28.435065 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.435550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.435997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.436691 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:28.437173 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:28.437598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:28.452543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:28.460771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-74623f56-0481-49a8-abb3-6d6a6297be22 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1722 microversion: 2.1 time: 0.190967 Sep 09 01:54:28.461438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 364/687] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:28 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:28.804570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:28.812919 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8dd87041-08e4-4ffc-b97f-7ba467aa07d3 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.391448 Sep 09 01:54:28.813451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 324/688] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:28 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:29.484562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:29.486023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:29.493078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:29.493572 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:29.494254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:29.495251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:29.495867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:29.496454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:29.630333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:29.638409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-969d02cb-bf79-4574-b219-becf847f01c7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1722 microversion: 2.1 time: 0.157728 Sep 09 01:54:29.639142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 365/689] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:29 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:29.835346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:29.835952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:29.842341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:29.842824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:29.843254 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:29.843936 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:29.844387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:29.844806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:29.977304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:29.985770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d356e333-4a1f-43a7-8a97-fcf46f745a49 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.154266 Sep 09 01:54:29.986335 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 325/690] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:29 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:30.452389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:30.458306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:30.458789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:30.459222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:30.481584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Going to try to stop instance {{(pid=126895) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 01:54:30.522047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-78c5c3f8-f950-4bef-934b-266dbee2ecf1 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action" status: 202 len: 0 microversion: 2.1 time: 0.073268 Sep 09 01:54:30.522648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 366/691] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:54:30 2022] POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:54:30.531086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:30.531718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:30.537558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:30.538034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:30.538466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:30.539141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:30.539589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:30.540045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:30.662848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:30.663567 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:30.664200 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:30.669662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:30.670135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:30.670560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:30.671239 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:30.671685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:30.671979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7442e02b-4d37-4239-84fc-0705dc4eb4df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.144661 Sep 09 01:54:30.672100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:30.672546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 326/692] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:30 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:30.800902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:30.810132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e70124a3-c6ed-41dd-94e3-fca98eb1f61e tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1722 microversion: 2.1 time: 0.151458 Sep 09 01:54:30.810882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 367/693] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:30 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:30.999511 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8529cd82-0f79-4067-bcdf-cce664cf1e21", "name": "network-vif-plugged", "status": "completed", "tag": "0fe1d40f-8ad5-411d-a904-f24754837359"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:31.007569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:31.008181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:31.015759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.015934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.016240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.016378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.016692 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.016843 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.017549 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.018000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.018417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.027906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] Creating event network-vif-plugged:0fe1d40f-8ad5-411d-a904-f24754837359 for instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 on hv-cinder-85221 Sep 09 01:54:31.032676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-50058779-229b-4194-b90a-ccaa076deef7 req-8c6c68d1-b856-42d0-bedf-e992055d0df6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093782 Sep 09 01:54:31.033308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 327/694] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:54:31.148006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:31.157979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1ca416c5-3075-4bf2-99a4-6378ab8c7748 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.154259 Sep 09 01:54:31.158540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 368/695] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:31 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:31.695871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:31.696610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:31.702700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.703188 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.703624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.704316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.704772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.705234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.833003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:31.833760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:31.834369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:31.841254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.841533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b8de7ba0-4f1b-4bb5-9f75-865d21929559 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.149836 Sep 09 01:54:31.841732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.842062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 328/696] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:31 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:31.842263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.842823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:31.843266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:31.843681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:31.972544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:31.981258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4e34d0e-7dbf-426a-a9d8-7e0b230b0baf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1722 microversion: 2.1 time: 0.151382 Sep 09 01:54:31.981809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 369/697] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:31 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:32.181208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:32.181900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:32.188529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:32.189015 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:32.189478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:32.190232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:32.190686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:32.191111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:32.317989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:32.325882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-513731c5-2d07-4818-9ee8-63dff74d7f37 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.148842 Sep 09 01:54:32.326463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 329/698] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:32 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:32.864673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:32.865344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:32.872596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:32.873102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:32.873542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:32.874232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:32.874686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:32.875105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.002162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:33.004807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:33.005451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:33.009990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-426cbfd0-5af5-4ccc-a5c0-4ab11e69434b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.149124 Sep 09 01:54:33.010555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 370/699] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:32 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:33.011319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.011818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.012241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.012930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.013418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.013842 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.140933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:33.148909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e5bb1971-7646-473e-8295-598ed1a241bb tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1728 microversion: 2.1 time: 0.147848 Sep 09 01:54:33.149983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 330/700] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:32 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:33.171695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:33.172756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:33.178675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.179156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.179587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.180266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.183342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.183342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.258017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cce2b236-695e-4f64-be56-0f5adf94caa8 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090088 Sep 09 01:54:33.259316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 371/701] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:54:33 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:54:33.349896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:33.350699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:33.357558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.358119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.358641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.359380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:33.359926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:33.360419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:33.489779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:33.498217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e3c7a0f5-fdf3-4b53-ab17-27067e701048 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.152266 Sep 09 01:54:33.498786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 331/702] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:33 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:34.033580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:34.034309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:34.040895 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:34.041487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:34.042003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:34.042771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:34.043298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:34.043794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:34.182846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:34.195674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-475e597c-f607-44fb-98da-bf5aa4462454 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.166309 Sep 09 01:54:34.196962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 372/703] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:34 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:34.236263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:34.246440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:34.246923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:34.247347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:34.258916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] Creating event network-changed:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:54:34.263865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-ed8e0952-ff2d-48c9-8f9e-6e4b3d98e110 req-9229cd7f-ad04-4c5f-9c75-9b2feef00cab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104048 Sep 09 01:54:34.264455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 332/704] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:54:34.520048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:34.520739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:34.527198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:34.527678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:34.528101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:34.528781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:34.529261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:34.529676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:34.670014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:34.677568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d74ee78e-3a7a-401e-ad04-881a6ff87116 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1319 microversion: 2.1 time: 0.161286 Sep 09 01:54:34.678132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 373/705] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:34 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:35.220589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:35.221487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:35.228396 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.228966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.229502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:35.230742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.230742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.231268 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:35.367691 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:35.375603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-79e294fa-ad66-467e-bb34-3909add18a78 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.160012 Sep 09 01:54:35.376169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 333/706] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:35 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:35.700509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:35.701048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:35.707390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.707876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.708308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:35.708987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.709466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.709888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:35.908653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:35.918937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aa8703fc-db5e-4d1a-9f1c-bd0b1dfe44dd tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1508 microversion: 2.1 time: 0.222764 Sep 09 01:54:35.919517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 374/707] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:35 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:35.941684 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fac85ef-53a3-4897-8b7a-43112a202f10", "device": "/dev/sdb"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:35.944141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:35.950943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.951353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.951781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:35.952493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:35.952944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:35.953412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:36.235109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-094a5489-d00e-49a7-bf22-b25afc1e3dd7 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "POST /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297253 Sep 09 01:54:36.235775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 334/708] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:54:35 2022] POST /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:54:36.278422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:54:36.290900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:36.290900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:36.292053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:36.306173 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] Creating event network-changed:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:54:36.311008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-ac9e7123-17c7-4611-912a-97185a900518 req-de2733d9-116c-4a06-8ea8-763179e39c7d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036154 Sep 09 01:54:36.311672 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 375/709] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:54:36.399408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:36.400101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:36.406272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:36.406754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:36.407186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:36.407874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:36.408327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:36.408750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:36.619558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:36.627170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8f9ff94c-5b22-48a9-baf7-80290377162d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.232419 Sep 09 01:54:36.627736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 335/710] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:36 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:37.651978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:37.652670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:37.659251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:37.660044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:37.660478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:37.661175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:37.661625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:37.662037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:37.665176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:37.806125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:37.813629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-be1fc881-6383-4cbc-801f-0a66190eb34d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.166921 Sep 09 01:54:37.814191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 376/711] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:37 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:38.836117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:38.836728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:38.843244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:38.843724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:38.844155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:38.844840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:38.845316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:38.845740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:38.973727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:38.981471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c6f8a057-bc76-4530-97b8-e72f90d4d3b4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.149142 Sep 09 01:54:38.982042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 336/712] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:38 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:40.004875 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:40.005512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:40.012436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:40.012915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:40.013387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:40.014062 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:40.014509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:40.014928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:40.143550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:40.151639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-99eb787a-4c4b-4e6b-855b-c678ef57d72b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.150518 Sep 09 01:54:40.152131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 377/713] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:39 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:41.174381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:41.174923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:41.181677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:41.182163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:41.183203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:41.183904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:41.184361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:41.184781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:41.314150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:41.321811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-39bf0707-b456-4144-9e62-57bcd3064448 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.151335 Sep 09 01:54:41.322372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 337/714] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:41 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:42.345581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:42.346181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:42.353886 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:42.354359 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:42.354781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:42.355450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:42.355893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:42.356304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:42.484328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:42.491895 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f8f65f78-e844-4dc7-9e6e-a426f495d64c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.150127 Sep 09 01:54:42.493034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 378/715] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:42 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:43.515632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:43.516169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:43.522568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:43.523050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:43.523479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:43.524658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:43.525208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:43.525633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:43.651133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:43.653419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:43.660789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5206dda1-9c3f-431f-812b-26ab2ab64e3a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.149093 Sep 09 01:54:43.661409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 338/716] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:43 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:44.683676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:44.684291 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:44.690297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:44.690777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:44.691204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:44.691887 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:44.692335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:44.692757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:44.824269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:44.832824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-00e2b6fe-f45d-4d9d-ac57-406fcd9097af tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.153156 Sep 09 01:54:44.833394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 379/717] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:44 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:45.858326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:45.858932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:45.861751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:45.867799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:45.868286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:45.868975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:45.869693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:45.870154 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:45.870583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:46.015642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:46.023181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8fe57f85-9d3b-4f70-8a24-a9461e97be18 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.168743 Sep 09 01:54:46.024370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 339/718] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:45 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:47.046385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:47.046994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:47.049332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=62 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:54:47.054489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:47.054971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:47.055402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:47.056085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:47.056541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:47.056960 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:47.182706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:47.190734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e7027dd1-e9b5-4f01-9a2e-143644881961 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.147683 Sep 09 01:54:47.190861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 380/719] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:47 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:48.215133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:48.215931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:48.222290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:48.222765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:48.223192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:48.223872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:48.224317 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:48.224734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:48.354504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:48.362277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-24eaaaaf-9926-4c12-a502-b24b6cf17be5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.152432 Sep 09 01:54:48.362833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 340/720] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:48 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:49.385771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:49.386375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:49.393012 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:49.393531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:49.393954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:49.394625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:49.395080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:49.395487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:49.521519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:49.529088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c9b7bc6d-04a8-4974-9bc4-8365a14e4f9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.147702 Sep 09 01:54:49.529650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 381/721] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:49 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:50.551976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:50.552571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:50.559588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:50.560061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:50.560490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:50.561274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:50.561720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:50.562136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:50.688701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:50.696359 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ad3562db-243f-42b4-94c7-8c9434a8f2f7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.148305 Sep 09 01:54:50.696923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 341/722] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:50 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:51.719120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:51.719746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:51.726038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:51.727144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:51.727576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:51.728247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:51.728690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:51.729129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:51.858565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:51.866202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-102e48de-022b-4a36-a0ad-e51ed48b4889 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.150928 Sep 09 01:54:51.866759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 382/723] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:51 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:52.889953 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:52.890545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:52.897012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:52.897601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:52.898033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:52.899296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:52.899748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:52.900168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:53.026830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:53.034361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e6e9db3f-6715-4591-876d-e715cbc28580 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.148325 Sep 09 01:54:53.034918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 342/724] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:52 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:54.057371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:54.058015 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:54.064437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:54.064914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:54.065373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:54.066055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:54.066509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:54.066926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:54.196798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:54.204446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c183e8d1-073e-44a3-847c-58b865ba1e73 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.150889 Sep 09 01:54:54.205008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 383/725] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:54 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:55.227601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:55.228215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:55.234513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:55.234989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:55.235417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:55.236095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:55.236545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:55.236966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:55.363067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:55.371911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1438c4d7-5f5a-43e5-be75-46bb3af0f0dc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.148007 Sep 09 01:54:55.372478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 343/726] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:55 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:56.395507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:56.396114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:56.403124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:56.403608 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:56.404037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:56.404722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:56.405196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:56.405618 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:56.537644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:56.545495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-28a33ab2-4be1-4b98-a222-3cc6a2651b69 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.153857 Sep 09 01:54:56.546069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 384/727] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:56 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:57.567880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:57.568491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:57.575489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:57.575972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:57.576403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:57.577116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:57.577573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:57.577997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:57.705863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:57.713527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-18fa5771-b7cc-403a-87d2-304c2df7bd97 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.149596 Sep 09 01:54:57.714231 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 344/728] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:57 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:54:58.736841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:58.737469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:58.744002 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:58.744475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:58.744900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:58.745605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:58.746053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:58.746462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:58.872126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:54:58.879710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-40a6ff94-687a-4c19-a959-9f55dc831c46 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1677 microversion: 2.1 time: 0.146702 Sep 09 01:54:58.880265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 385/729] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:58 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:54:59.903167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:54:59.903776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:54:59.910127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:59.910605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:59.911040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:54:59.911721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:54:59.912174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:54:59.912589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.043048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:00.052037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-144eb450-16c9-4727-b2da-c299a0eec804 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1654 microversion: 2.1 time: 0.152755 Sep 09 01:55:00.052629 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 345/730] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:54:59 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:00.078340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:55:00.085510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:00.085995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:00.086423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.110495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Going to try to start instance {{(pid=126895) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 01:55:00.152321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6c302592-a1df-4040-b63b-b719663f1d1b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action" status: 202 len: 0 microversion: 2.1 time: 0.079591 Sep 09 01:55:00.152842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 386/731] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:55:00 2022] POST /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:55:00.160903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:00.161571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:00.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:00.167979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:00.168510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.169286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:00.169713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:00.170159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.325504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:00.333266 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-21629926-c723-4d6b-b3fd-6a3d87b4ccef tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1663 microversion: 2.1 time: 0.176165 Sep 09 01:55:00.333833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 346/732] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:00 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:00.760250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:00.760822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:00.766875 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:00.767353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:00.767782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.768462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:00.768908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:00.769349 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:00.848286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lazy-loading 'services' on Instance uuid 8529cd82-0f79-4067-bcdf-cce664cf1e21 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:55:00.974232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c4c7f043-f42f-4ea6-bf19-2a4887c5073f tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21/os-volume_attachments/4fac85ef-53a3-4897-8b7a-43112a202f10" status: 202 len: 0 microversion: 2.1 time: 0.218673 Sep 09 01:55:00.974876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 387/733] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:55:00 2022] DELETE /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21/os-volume_attachments/4fac85ef-53a3-4897-8b7a-43112a202f10 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:55:01.356386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:01.357222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:01.363831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:01.364318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:01.364765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:01.365473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:01.365927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:01.366353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:01.499751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:01.508298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fa9bb85a-3c35-4b53-a535-c393cf36e5e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1663 microversion: 2.1 time: 0.156031 Sep 09 01:55:01.508897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 347/734] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:01 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:55:02.533894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:02.534582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:02.540594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:02.541134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:02.541525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:02.542196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:02.542641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:02.543053 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:02.675141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:02.682860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a13c365b-0b91-442a-8e11-6d3dedba069e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1667 microversion: 2.1 time: 0.153674 Sep 09 01:55:02.683419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 388/735] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:02 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:03.168895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:03.169518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:03.175829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:03.176306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:03.176739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:03.177464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:03.177933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:03.178345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:03.204237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:55:03.277444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c8fe867b-5b59-41cb-ba38-7b5df90c6d4c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 204 len: 0 microversion: 2.1 time: 0.112032 Sep 09 01:55:03.278050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 348/736] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:55:03 2022] DELETE /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:55:03.286446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:03.287066 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:03.293476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:03.293960 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:03.294398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:03.295081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:03.295562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:03.295987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:03.426348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:03.434598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8fd6cff8-4f4a-4c5d-84e3-9c3ff80fd547 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1514 microversion: 2.1 time: 0.152151 Sep 09 01:55:03.435165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 389/737] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:03 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:04.457514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:04.458215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:04.464971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:04.465484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:04.465915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:04.466598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:04.467051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:04.467467 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:04.593664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:04.601818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e6ce0aea-3a7a-4beb-89cf-18eeb912040c tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1514 microversion: 2.1 time: 0.148551 Sep 09 01:55:04.602381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 349/738] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:04 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:05.624727 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:05.625361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:05.631795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:05.632764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:05.633330 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:05.634012 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:05.634462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:05.634877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:05.759861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:05.767481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5b0a9daf-40ef-4107-9149-951eb70a9cc8 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1514 microversion: 2.1 time: 0.146585 Sep 09 01:55:05.768047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 390/739] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:05 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:06.790477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:06.791235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:06.797676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:06.798159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:06.798591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:06.799280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:06.799761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:06.800178 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:06.994422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efef230f10394d5eb31976cd0d693eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6eb96014394a1bbd7838dc2eb03c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:07.002083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f49efe90-6bde-4ca9-8882-3311f6f26831 tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 200 len: 1514 microversion: 2.1 time: 0.216220 Sep 09 01:55:07.002763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 350/740] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:06 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:07.107440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8529cd82-0f79-4067-bcdf-cce664cf1e21", "name": "network-vif-deleted", "tag": "0fe1d40f-8ad5-411d-a904-f24754837359"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:55:07.118925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:07.119395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:07.119809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:07.123001 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:55:07.134468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] Creating event network-vif-deleted:0fe1d40f-8ad5-411d-a904-f24754837359 for instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 on hv-cinder-85221 Sep 09 01:55:07.139590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-7bd8ee1e-cc16-4eb2-928d-740ba431e294 req-9f62b5ae-1d22-413f-878d-26a561793c7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Sep 09 01:55:07.140326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 391/741] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:55:08.026976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:08.027587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] [instance: 8529cd82-0f79-4067-bcdf-cce664cf1e21] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:08.033916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:08.034398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:08.034832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:08.035516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:08.035967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:08.036391 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:08.051754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] HTTP exception thrown: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Request method failure captured: Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 HTTP/1.1 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpxj9LaVGm8A1CP1sHdTZHawB4mKplYHW3zD1EEaZD3AftTYYZjxfA5q4p_7Lt-ktrnJqyEHMlK08-4Nrz56uxtB3Fcl86SVpiY2wO7Jjwq6oVvjOIgKz-F9tSVmnZF7K94znZG11wVV5qQdN9xdaKm8jFIMfyEtYfmn3ECVE5zC4WI Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: bf6eb96014394a1bbd7838dc2eb03c13 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:55:08.053403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bf6eb96014394a1bbd7838dc2eb03c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bf6eb96014394a1bbd7838dc2eb03c13", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: bf6eb96014394a1bbd7838dc2eb03c13 Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1195224046 Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesSnapshotTestJSON-1195224046-project Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: efef230f10394d5eb31976cd0d693eda Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesSnapshotTestJSON-1195224046-project Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. Sep 09 01:55:08.055011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '8529cd82-0f79-4067-bcdf-cce664cf1e21'} Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:55:08.056041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. Sep 09 01:55:08.057639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:55:08.059177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] Returning 404 to user: Instance 8529cd82-0f79-4067-bcdf-cce664cf1e21 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:55:08.059177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7d2c69d2-0861-4e45-b11a-b520fd9de0ab tempest-VolumesSnapshotTestJSON-1195224046 tempest-VolumesSnapshotTestJSON-1195224046-project] 10.222.0.15 "GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21" status: 404 len: 111 microversion: 2.1 time: 0.032311 Sep 09 01:55:08.059177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 351/742] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:08 2022] GET /compute/v2.1/servers/8529cd82-0f79-4067-bcdf-cce664cf1e21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:55:45.521134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=23 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:55:45.522260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 01:55:45.522431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Fri Sep 9 01:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 (ip 10.222.0.15) !!! Sep 09 01:55:45.527775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:45.528355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:45.535557 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:45.536039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:45.536956 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:45.537664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:45.538117 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:45.538536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:45.563981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:55:45.637611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c9996231-028c-4950-9dfe-72e9cc82a7e0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 204 len: 0 microversion: 2.1 time: 0.118021 Sep 09 01:55:45.638660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 392/743] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:55:45 2022] DELETE /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:55:45.648816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:45.649448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:45.651585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:55:45.652228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:55:45.653834 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 01:55:45.653994 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Fri Sep 9 01:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 (ip 10.222.0.15) !!! Sep 09 01:55:45.667649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:45.668224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:45.668654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:45.669378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:45.669831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:45.670249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:45.799025 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:45.807115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7b8abba9-3c07-4367-b125-9ce885e3eab6 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.163994 Sep 09 01:55:45.807671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 352/744] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:45 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:55:46.830805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:46.831502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:46.837996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:46.838472 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:46.838897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:46.839566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:46.840012 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:46.840427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:46.970143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:46.978453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-45c1ea0e-fb6e-4623-8737-4d00b8c499a3 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.151847 Sep 09 01:55:46.979013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 393/745] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:46 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:48.003057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:48.003667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:48.010722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:48.011202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:48.011634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:48.012314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:48.012768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:48.013217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:48.143776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:48.151999 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d7c32f7b-beea-45aa-8685-b5c6dfd85abb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.152802 Sep 09 01:55:48.152567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 353/746] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:47 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:49.175269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:49.175812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:49.182237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:49.182712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:49.183136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:49.183806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:49.184249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:49.184661 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:49.312368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:49.320458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c71ba3eb-4aa2-469a-b019-ba35c1774271 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.149110 Sep 09 01:55:49.321009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 394/747] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:49 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:50.343763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:50.344372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:50.350950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:50.351427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:50.351861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:50.352542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:50.353021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:50.353476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:50.486097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:50.494750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2473f725-ebcc-4e87-930d-21410e8e6f5c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.154791 Sep 09 01:55:50.495304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 354/748] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:50 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:51.518057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:51.518593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:51.525712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:51.526200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:51.526633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:51.527315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:51.527771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:51.528191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:51.657730 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:51.665360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d5ac9507-20fe-4b6e-afd6-dcfa0836be7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.151205 Sep 09 01:55:51.665925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 395/749] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:51 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:52.687562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:52.688746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:52.695290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:52.695773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:52.696203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:52.697552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:52.697552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:52.697951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:52.935213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:52.943236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ce3362e7-f760-4a6e-bd45-5fae1a548e77 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1578 microversion: 2.1 time: 0.259420 Sep 09 01:55:52.943799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 355/750] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:52 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1578 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:53.400928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65605f6-ff2d-4119-94d5-1c1af235ce41", "name": "network-vif-deleted", "tag": "c9baef20-a174-40c1-8e60-d25d6a026de4"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:55:53.412605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:53.413100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:53.414337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:53.427919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] Creating event network-vif-deleted:c9baef20-a174-40c1-8e60-d25d6a026de4 for instance c65605f6-ff2d-4119-94d5-1c1af235ce41 on hv-cinder-85221 Sep 09 01:55:53.433869 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-3da49f98-4581-40b3-8e63-a4af56b16494 req-0f06334e-b6ee-4614-b5ca-3592bc2e3ea4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036366 Sep 09 01:55:53.434391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 396/751] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:55:53.968076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:53.969636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:53.977487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:53.978512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:53.979269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:53.980134 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:53.981020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:53.981615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:54.018978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:54.019633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:54.020407 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:54.021022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lazy-loading 'fault' on Instance uuid c65605f6-ff2d-4119-94d5-1c1af235ce41 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:55:54.068866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:54.082137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3947192e-49c3-458a-aa00-665a52469a8f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 200 len: 1230 microversion: 2.1 time: 0.118070 Sep 09 01:55:54.083738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 356/752] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:53 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:55.106616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:55.107288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:55.113322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:55.113799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:55.114224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:55.114904 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:55.115350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:55.115764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:55.128779 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] HTTP exception thrown: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Request method failure captured: Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 HTTP/1.1 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpwWp8jRGrzC7Vx_ZyM-UDZYm9t2sBGtaD39VaTi9b1HhQBcs0BI3DB7Tep2LYZTdqcW7wGKlFvwE1CbNkvnRtd2yrZj5WEo749nI0eTvfHRTypwirH_Wz4gwIGzPxHZZAS7eDd3uJGuxHp7neyWVS0HuBaxMbHqJjs3wOfyA_LCMS0 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:55:55.130882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_826001ffb29b4d42a5c299154c17b93e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestVolumeBootPattern-1611771857 Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestVolumeBootPattern-1611771857-project Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: fa5465b818f34778a1d51278653488ed Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestVolumeBootPattern-1611771857-project Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 01:55:55.132426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'c65605f6-ff2d-4119-94d5-1c1af235ce41'} Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:55:55.133326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 01:55:55.134785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:55:55.136098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Returning 404 to user: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:55:55.136098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0e7c2e25-76ee-4e97-9634-21374ea4e551 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 404 len: 111 microversion: 2.1 time: 0.030258 Sep 09 01:55:55.136098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 397/753] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:55 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:55:55.227945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1107444480", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785472344", "security_groups": [{"name": "tempest-secgroup-smoke-1748851516"}], "block_device_mapping_v2": [{"uuid": "946d871e-f253-42e5-b19a-2611e41ed61f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:55:55.347833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] validate_networks() for [('eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:55:55.728020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:55:55.728532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:55:55.729370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:55:55.729778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:55:55.730193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:55:55.739656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:55.740184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:55.740623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:55.741404 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:55.741903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:55.742350 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:55.758730 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:55:55.762595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for user fa5465b818f34778a1d51278653488ed and project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:55:55.820875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:55:55.823346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='946d871e-f253-42e5-b19a-2611e41ed61f',volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:55:55.952911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-587251e9-1ab9-4aba-92e9-bc7af6b74f2a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728704 Sep 09 01:55:55.953582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 357/754] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:55:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:55:55.964371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0df53941-8857-4221-bb0f-1d367f4cb4c9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:55.965078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0df53941-8857-4221-bb0f-1d367f4cb4c9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:56.019663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0df53941-8857-4221-bb0f-1d367f4cb4c9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:56.026413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0df53941-8857-4221-bb0f-1d367f4cb4c9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1094 microversion: 2.1 time: 0.065840 Sep 09 01:55:56.026962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 398/755] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:55 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:57.049494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:57.050036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:57.056526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:57.057011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:57.057478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:57.058164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:57.058618 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:57.059036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:57.118808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:57.126435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-16ac4c1f-b23e-4901-8690-711433aa9df8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1192 microversion: 2.1 time: 0.081388 Sep 09 01:55:57.127003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 358/756] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:57 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:58.153006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:58.154524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:58.163961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:58.164677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:58.165301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:58.165993 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:58.166444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:58.166860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:58.406272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:58.416285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0bbd368d-d942-489e-8ddb-aaa3379f91a0 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.270127 Sep 09 01:55:58.417318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 399/757] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:58 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:55:59.075564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8469534-2b09-4d9d-af78-5295d54a1783", "tag": "9dbbdceb-8367-408d-9f33-9058546b3288"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:55:59.086811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:59.087704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:59.087917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:59.103427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] Creating event network-changed:9dbbdceb-8367-408d-9f33-9058546b3288 for instance a8469534-2b09-4d9d-af78-5295d54a1783 on hv-cinder-85221 Sep 09 01:55:59.108940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-b72bade5-a7a5-417b-92b2-88415428eca8 req-f2a64bf0-cd18-46fa-bc8f-92c2007a29fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037097 Sep 09 01:55:59.109556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 359/758] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:55:59.439703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:55:59.440312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:55:59.446696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:59.447175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:59.447601 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:59.448277 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:55:59.448725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:55:59.449164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:55:59.614046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:55:59.621880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ffdbd6f5-6d61-4b4b-9988-18ed1c3604eb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.186084 Sep 09 01:55:59.622431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 400/759] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:55:59 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:00.644235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:00.645843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:00.651894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:00.652367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:00.652792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:00.653505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:00.653955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:00.654370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:00.859923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:00.868347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1718c2da-1a21-4438-a4b0-98c6ad9b80fa tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.228248 Sep 09 01:56:00.881081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 360/760] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:00 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:01.890931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:01.891545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:01.898759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:01.899252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:01.899680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:01.900690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:01.901115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:01.901539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:02.034809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:02.042438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6bb03069-dbe2-4156-8a58-6e87d04b074e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.155328 Sep 09 01:56:02.042998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 401/761] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:01 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:03.064721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:03.065263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:03.071450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:03.071922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:03.072349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:03.073029 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:03.073568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:03.073983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:03.199843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:03.207796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f2a0f690-0d25-4ca8-ad74-1aa84be9315e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.146527 Sep 09 01:56:03.208355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 361/762] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:03 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:03.957761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:03.958286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:03.964968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:03.965484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:03.965922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:03.966666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:03.967168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:03.967637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:04.052652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lazy-loading 'services' on Instance uuid 8cfd7b66-e9a2-4276-8121-cbef564f363f {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:04.121575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-cc6d896f-a1ca-46ac-9372-13aedbf90ed7 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments/6ad86971-42f9-4029-a50e-b364214f136e" status: 202 len: 0 microversion: 2.1 time: 0.167841 Sep 09 01:56:04.122172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 402/763] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:56:03 2022] DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments/6ad86971-42f9-4029-a50e-b364214f136e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:04.130517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:04.132744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:04.139132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:04.139722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:04.140141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:04.140831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:04.141385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:04.141736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:04.175477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-14f8c480-4770-46e7-b529-236dfa391f44 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 Sep 09 01:56:04.176925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 362/764] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:56:04 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:04.230592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:04.231289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:04.237466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:04.237947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:04.238380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:04.239664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:04.240114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:04.240524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:04.373595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:04.381043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a256209b-cff3-45fa-8de3-414cf18c8df4 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.154608 Sep 09 01:56:04.381649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 403/765] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:04 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:05.189464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:05.192270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:05.198797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.199281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.199716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.200409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.200862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.201305 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.230302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a2572fe2-a15b-4f73-a459-eef9d32c1e3c tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044827 Sep 09 01:56:05.230866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 363/766] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:56:05 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 01:56:05.308784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:05.309364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:05.315587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.316063 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.317093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.317796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.318245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.318660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.343493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:05.404154 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:05.404794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:05.410946 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.411296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.412022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.412435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.412881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.413603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.418103 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d9c84abd-2461-4765-a71e-86c15049564d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 204 len: 0 microversion: 2.1 time: 0.112804 Sep 09 01:56:05.418803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 404/767] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:05 2022] DELETE /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:56:05.427920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:05.428710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:05.434589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.435068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.435504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.436187 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:05.436641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:05.437073 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:05.608232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:05.611395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:05.616453 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9501b4c0-c212-4b2c-8a7e-90d88d065bb9 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.216385 Sep 09 01:56:05.617015 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 364/768] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:05 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:05.620001 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0155e276-f13f-47c0-9596-41d2fdf3b450 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.196656 Sep 09 01:56:05.620593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 405/769] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:05 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:06.638941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:06.639545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:06.641517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:06.642370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:06.642592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:06.642997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:06.646115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:06.649026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:06.649531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:06.649957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:06.650640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:06.651083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:06.651499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:06.651794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:06.652276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:06.652709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:06.653474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:06.653931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:06.654351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:06.840701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:06.848568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:06.849640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-817d78d8-850c-47f1-981c-f534b11cde23 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.214395 Sep 09 01:56:06.850215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 365/770] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:06 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:06.850759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:06.858357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5de1ed10-140a-4fc6-a660-0db3e6ad3e71 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.219810 Sep 09 01:56:06.858917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 406/771] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:06 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:07.873099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:07.873710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:07.880668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:07.881175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:07.881367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:07.881786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:07.882097 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:07.882280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:07.882732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:07.883150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:07.889926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:07.890438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:07.890897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:07.891576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:07.892025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:07.892570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.084234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:08.091617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:08.094518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c23fc4ff-d962-4da7-ac84-b91cd892be08 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.225232 Sep 09 01:56:08.095595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 366/772] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:07 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:08.099878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b333fc2b-0178-4741-b054-712bae1808cf tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.222547 Sep 09 01:56:08.100998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 407/773] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:07 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:08.522027 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:08.522549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:08.528816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.529390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.529880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.530651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.531164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.531632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.556341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-74ceab93-c079-4771-a2c5-8c4087711341 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/ips" status: 200 len: 148 microversion: 2.1 time: 0.266571 Sep 09 01:56:08.556909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 367/774] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:56:08 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/ips => generated 148 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:08.568974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c237716-5256-468e-b826-f2eae74c60d8"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:08.571496 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:08.577480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.577958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.578388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.579067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.579520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.579940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.656884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: POST /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/os-volume_attachments HTTP/1.1 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 74 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:56:08.658612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {"volumeAttachment": {"volumeId": "3c237716-5256-468e-b826-f2eae74c60d8"}} Sep 09 01:56:08.660884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'server_id': 'b6f2946f-79f7-4ccb-91df-7125a9e02ad4', 'body': {'volumeAttachment': {'volumeId': '3c237716-5256-468e-b826-f2eae74c60d8'}}} Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:08.662674 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:08.664113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 400 to user: Invalid volume: volume 3c237716-5256-468e-b826-f2eae74c60d8 is already attached to instances: ab363ee7-d833-4edb-95de-48d7e54bc297 {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e873275a-eee9-4973-84a1-81a13228f447 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095026 Sep 09 01:56:08.665579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 408/775] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:56:08 2022] POST /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 01:56:08.669513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:08.670008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:08.676516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.676995 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.677451 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.678131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.678585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.679008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.704655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:08.738818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:08.779782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-932bda8c-e40c-484f-bd25-0488ebffa7a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 204 len: 0 microversion: 2.1 time: 0.113753 Sep 09 01:56:08.780373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 368/776] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:08 2022] DELETE /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 01:56:08.788958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:08.789590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:08.796050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.796524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.796953 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.797659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:08.798108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:08.798529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:08.930937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:08.938643 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-13548dff-dc23-4fb5-b05a-f8e86b37a9eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1679 microversion: 2.1 time: 0.153975 Sep 09 01:56:08.939219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 409/777] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:08 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:09.119583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:09.120281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:09.125477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:09.126084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:09.126738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.127218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.127773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:09.128341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.128800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.129262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:09.132509 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.132984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.133434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:09.134120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.134547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.134962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:09.323024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:09.326529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:09.330889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1ff5d40c-e425-4fc2-810a-f3465405f028 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.209098 Sep 09 01:56:09.331966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 410/778] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:09 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:09.334825 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c244d938-3da0-4b30-8f6c-b5a5fb2beabc tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.219631 Sep 09 01:56:09.335385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 369/779] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:09 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:09.962375 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:09.962987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:09.969520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.970009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.970441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:09.971121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:09.971574 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:09.971995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:10.100758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:10.108432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-57838fff-f2f5-41ae-a31e-6f6d50208f83 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1679 microversion: 2.1 time: 0.149925 Sep 09 01:56:10.108994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 411/780] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:09 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:10.354610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:10.355308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:10.357635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:10.358377 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:10.362443 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:10.362931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:10.363362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:10.364081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:10.364398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:10.364520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:10.364882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:10.364990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:10.365354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:10.366042 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:10.366491 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:10.366911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:10.574094 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:10.578536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:10.582070 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-05bd0c58-9961-49ca-9df2-f2a4e003e047 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.231366 Sep 09 01:56:10.582716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 370/781] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:10 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:10.586985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-be07a523-9fd6-499e-a577-a7ce1835c477 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.233230 Sep 09 01:56:10.587550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 412/782] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:10 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:11.131849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:11.132447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:11.138433 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.138908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.139334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.140011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.140452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.141286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.268633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:11.277911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9d922273-50b9-45e1-a289-b9d576801622 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1679 microversion: 2.1 time: 0.149860 Sep 09 01:56:11.278481 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 371/783] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:11 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:11.605580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:11.606191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:11.609791 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:11.610405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:11.612612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.613223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.613664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.614351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.615007 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.615436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.617175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.617920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.618363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.619056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:11.619507 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:11.619929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:11.904955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:11.913277 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0a541c53-20a2-4aa5-88ef-0354d57d13a4 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1688 microversion: 2.1 time: 0.311531 Sep 09 01:56:11.913852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 413/784] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:11 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1688 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:11.919743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:11.927906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-62948f35-55fa-4ee4-8e2a-b3998b0f6f6a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.321842 Sep 09 01:56:11.928472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 372/785] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:11 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:12.302162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:12.303009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:12.309327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.309806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.310235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:12.310918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.311365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.311801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:12.879236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:12.887858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1faaa84a-cc39-4cc4-bef9-a0fc8105ce71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1679 microversion: 2.1 time: 0.589756 Sep 09 01:56:12.888429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 414/786] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:12 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1679 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:12.937620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:12.938135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:12.945810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.946279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.946897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:12.947761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.948213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.948680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:12.950868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:12.951483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:12.957282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.957772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.958205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:12.958913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:12.959491 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:12.959916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:13.066056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:13.074806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7021d7c4-8db0-45da-bdd9-b80b594b4ef9 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1620 microversion: 2.1 time: 0.141057 Sep 09 01:56:13.075387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 373/787] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:12 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1620 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:13.322472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cfd7b66-e9a2-4276-8121-cbef564f363f", "name": "network-vif-deleted", "tag": "d1326dc5-f813-414d-9708-327e769a062f"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:13.322992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:13.333655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8d390b3b-9e7d-489d-9409-0c4cc745016c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.384079 Sep 09 01:56:13.334272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 415/788] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:12 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:13.355929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:13.356480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:13.357008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:13.372526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] Creating event network-vif-deleted:d1326dc5-f813-414d-9708-327e769a062f for instance 8cfd7b66-e9a2-4276-8121-cbef564f363f on hv-cinder-85221 Sep 09 01:56:13.380517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-4e2961c4-58e9-4675-a756-f7a2022bd238 req-c133e969-e434-4fc1-b7c2-13db4c99a7fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060797 Sep 09 01:56:13.381159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 374/789] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:13.497324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8469534-2b09-4d9d-af78-5295d54a1783", "name": "network-vif-plugged", "status": "completed", "tag": "9dbbdceb-8367-408d-9f33-9058546b3288"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:13.508086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:13.508836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:13.509536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:13.524057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] Creating event network-vif-plugged:9dbbdceb-8367-408d-9f33-9058546b3288 for instance a8469534-2b09-4d9d-af78-5295d54a1783 on hv-cinder-85221 Sep 09 01:56:13.529801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-b306ce49-453a-496d-910b-7349c5065917 req-192c68c8-424f-467d-bebb-bf79ed70bb85 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036239 Sep 09 01:56:13.530834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 416/790] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:13.913396 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:13.914898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:13.934816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:13.935874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:13.936388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:13.937212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:13.937966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:13.939221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.063605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:14.075452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e49113ad-eb9c-4fbe-af28-0154106101b5 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1611 microversion: 2.1 time: 0.167244 Sep 09 01:56:14.076047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 375/791] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:13 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1611 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:14.100694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:14.101487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:14.116262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:14.117974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:14.118458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.119177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:14.119642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:14.128034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.182421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:14.182914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:14.183346 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.183790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lazy-loading 'fault' on Instance uuid 8cfd7b66-e9a2-4276-8121-cbef564f363f {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:14.232541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:14.241455 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-37f6dee7-c2ed-465b-b171-50b308909dbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 200 len: 1335 microversion: 2.1 time: 0.146757 Sep 09 01:56:14.242046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 417/792] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:14 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 1335 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:14.355940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:14.356594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:14.363461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:14.363993 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:14.364429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.365168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:14.365626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:14.366056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:14.540843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:14.549602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f6b23c16-ba2e-4ce3-841b-6342d4575ee8 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.197551 Sep 09 01:56:14.561500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 376/793] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:14 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:15.103542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:15.104695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:15.111883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.112367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.112794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.113514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.114603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.115025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.147846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.148325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.148750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.149208 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'fault' on Instance uuid b6f2946f-79f7-4ccb-91df-7125a9e02ad4 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:15.188954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:15.196968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-642397a5-2ab4-4688-80da-a15c87bcafa1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1330 microversion: 2.1 time: 0.097334 Sep 09 01:56:15.197559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 418/794] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:15 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:15.265785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:15.266343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 8cfd7b66-e9a2-4276-8121-cbef564f363f] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:15.273400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.273922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.274423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.275192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.275656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.276120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.290973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] HTTP exception thrown: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Request method failure captured: Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f HTTP/1.1 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptyaCAmKuxdV93bhtYJbYv4rqJ5x0w_r5SWUS4684TBJ2fVu57gzwqawQ42RNEFcQJL_6N3_bw5TSrLR8-6_WXuc0QhjIWtvRiq-0QBBHsBEGdt-ZGKZK-ILeom5L9geBDVm_-GlrvLOniHepN_n40swMjxeBS8UjNV_vFgqbYaD1k Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:56:15.292612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6b35000faf844d758c12de9938c235a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6b35000faf844d758c12de9938c235a8", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 3153c9ff011f4ab8958fc49795e6f8f1 Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. Sep 09 01:56:15.294213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '8cfd7b66-e9a2-4276-8121-cbef564f363f'} Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:15.295108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. Sep 09 01:56:15.296528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:15.297876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Returning 404 to user: Instance 8cfd7b66-e9a2-4276-8121-cbef564f363f could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:15.297876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-aed45b47-4c7e-4343-98aa-8e6bc1104b49 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f" status: 404 len: 111 microversion: 2.1 time: 0.033042 Sep 09 01:56:15.297876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 377/795] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:15 2022] GET /compute/v2.1/servers/8cfd7b66-e9a2-4276-8121-cbef564f363f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:15.303249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e143a16a-c71b-4290-b538-ee8572ba3887 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '.version_select at 0x7f87dbe235e0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:15.307732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e143a16a-c71b-4290-b538-ee8572ba3887 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [a9418a19-4571-4a3e-b1c0-8a2b22721547] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 01:56:15.404985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f2946f-79f7-4ccb-91df-7125a9e02ad4", "name": "network-vif-deleted", "tag": "6022e8ff-02ea-4658-8b51-6f209d25406d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:15.414095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.414568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.414989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.425594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] Creating event network-vif-deleted:6022e8ff-02ea-4658-8b51-6f209d25406d for instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 on hv-cinder-85221 Sep 09 01:56:15.430217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-6895ab2d-a8c5-4c6d-a530-ea9a8f17ce48 req-650ce67d-796f-4b5e-8146-c24f0402755c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028809 Sep 09 01:56:15.430768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 378/796] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:15.574747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:15.575504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:15.581604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.582090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.582524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.583759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:15.584252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:15.584677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:15.717258 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:15.724806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cad51912-f4f9-43ce-90a0-4191a741ee25 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1266 microversion: 2.1 time: 0.154670 Sep 09 01:56:15.725397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 379/797] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:15 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:16.219937 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:16.220578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:16.222527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:16.228763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:16.229280 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:16.229708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:16.230421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:16.230868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:16.231283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:16.263157 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:16.263633 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:16.264057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:16.264493 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'fault' on Instance uuid b6f2946f-79f7-4ccb-91df-7125a9e02ad4 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:16.305330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:16.313078 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5940d5bf-60f8-4107-8563-ec66d41ef304 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 200 len: 1330 microversion: 2.1 time: 0.097246 Sep 09 01:56:16.313640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 380/798] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:16 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:16.315340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [None req-e143a16a-c71b-4290-b538-ee8572ba3887 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [a9418a19-4571-4a3e-b1c0-8a2b22721547] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 41166. Sep 09 01:56:16.321671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:16.337014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e143a16a-c71b-4290-b538-ee8572ba3887 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-354544929" status: 202 len: 0 microversion: 2.1 time: 1.038135 Sep 09 01:56:16.337645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 419/799] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 01:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-354544929 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:16.748421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:16.749164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:16.756634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:16.757640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:16.758501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:16.759874 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:16.760671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:16.761341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:16.965942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:16.973654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-523f9c63-0387-41bf-9fc5-afacca1bcccb tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1454 microversion: 2.1 time: 0.229267 Sep 09 01:56:16.974228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 381/800] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:16 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1454 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:16.996285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:16.996899 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:17.003777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:17.004203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:17.005193 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:17.005883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:17.006337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:17.006760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:17.150027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:17.158957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1b5ccfbe-f4dc-4d77-bc30-d18a18db7f11 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1454 microversion: 2.1 time: 0.166950 Sep 09 01:56:17.159529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 420/801] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:16 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:17.336213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:17.336922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:17.343575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:17.344059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:17.344489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:17.345216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:17.345665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:17.346077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:17.369489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 HTTP/1.1 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:56:17.371998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 01:56:17.373352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'b6f2946f-79f7-4ccb-91df-7125a9e02ad4'} Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:17.374089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 01:56:17.375346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:17.376490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:17.376490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-64d95927-f057-4a08-911f-b0a7408eefab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 404 len: 111 microversion: 2.1 time: 0.041782 Sep 09 01:56:17.376490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 382/802] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:17 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:17.388426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-24262620-a47d-4439-9fa8-68ddfafe2961 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '.version_select at 0x7f87d8870d30>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:17.408355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-24262620-a47d-4439-9fa8-68ddfafe2961 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453184586" status: 202 len: 0 microversion: 2.1 time: 0.023639 Sep 09 01:56:17.409249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 421/803] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 01:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453184586 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:18.138416 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:18.138907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:18.144952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:18.147543 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:18.148044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:18.148759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:18.149478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:18.149654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:18.249338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'services' on Instance uuid ab363ee7-d833-4edb-95de-48d7e54bc297 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:18.333372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f1fb0b76-9488-4f8f-84a7-56eff3b1746c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments/3c237716-5256-468e-b826-f2eae74c60d8" status: 202 len: 0 microversion: 2.1 time: 0.198700 Sep 09 01:56:18.333992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 383/804] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:56:18 2022] DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments/3c237716-5256-468e-b826-f2eae74c60d8 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:18.343059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:18.345343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:18.355286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:18.356346 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:18.356917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:18.358094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:18.358623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:18.359213 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:18.405090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ed806d24-5386-4407-92fe-69b323bdf24f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066674 Sep 09 01:56:18.405992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 422/805] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:56:18 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:18.836997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8469534-2b09-4d9d-af78-5295d54a1783", "tag": "9dbbdceb-8367-408d-9f33-9058546b3288"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:18.847013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:18.847494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:18.847949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:18.860053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] Creating event network-changed:9dbbdceb-8367-408d-9f33-9058546b3288 for instance a8469534-2b09-4d9d-af78-5295d54a1783 on hv-cinder-85221 Sep 09 01:56:18.865001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-798b34e9-a8b5-47bd-b46c-2152b5b06949 req-efa5b5fd-b4eb-46c4-a26a-fbe9fba182a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033022 Sep 09 01:56:18.865561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 384/806] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:19.323323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:19.323992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:19.331441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.332143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.333739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.334514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.335040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.335802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.374437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:19.419249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:19.421971 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:19.438340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.443840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.444595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.445639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.446419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.447198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.451435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:19.502118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2c96f509-5f77-4f32-9adf-ee94f0a46077 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 204 len: 0 microversion: 2.1 time: 0.183354 Sep 09 01:56:19.502716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 423/807] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:19 2022] DELETE /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:56:19.508111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-65e22098-9d5f-4f18-9c53-b964eec417ae tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093072 Sep 09 01:56:19.509670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 385/808] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:56:19 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 01:56:19.515908 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:19.516619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:19.523305 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.523793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.524428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.525162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.525683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.526096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.581647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:19.582144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:19.588857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.589384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.589820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.590523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.590977 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.591397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.619312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:19.634860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:19.668541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:19.677916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9f37a466-ffbb-470f-ba8c-60181f5cea2a tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1508 microversion: 2.1 time: 0.166207 Sep 09 01:56:19.678493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 424/809] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:19 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:19.703808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f9b4358c-1edb-4938-944e-044f69103832 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 204 len: 0 microversion: 2.1 time: 0.125811 Sep 09 01:56:19.704380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 386/810] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:19 2022] DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 01:56:19.712450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:19.713114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:19.720749 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.721272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.721706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.722400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:19.722852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:19.723824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:19.867348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:19.875279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8618511b-f713-4296-b4cb-b198e822b715 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1679 microversion: 2.1 time: 0.166649 Sep 09 01:56:19.875842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 425/811] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:19 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:20.701657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:20.702362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:20.708658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:20.709166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:20.709597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:20.710275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:20.710728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:20.711147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:20.899462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:20.899821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:20.906076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:20.906563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:20.907003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:20.907695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:20.908149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:20.908571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:20.940386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:20.948878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff4471d2-961e-4d6a-8660-29edcfcc7337 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1508 microversion: 2.1 time: 0.251424 Sep 09 01:56:20.949480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 387/812] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:20 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:21.496267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:21.503980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-253492ca-82b6-4b2e-896f-e9089980b3cd tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1679 microversion: 2.1 time: 0.609458 Sep 09 01:56:21.505192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 426/813] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:20 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1679 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:21.652934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:21.653505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:21.659565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.659990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.661043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:21.661766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.662226 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.662658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:21.685883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lazy-loading 'flavor' on Instance uuid f70e8adc-fc93-442f-8cd0-800c05ecc65b {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:21.794167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e182385e-47d3-41a4-84c7-45c3dcd4af64 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "POST /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b/action" status: 202 len: 0 microversion: 2.1 time: 0.144875 Sep 09 01:56:21.795210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 388/814] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:56:21 2022] POST /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 01:56:21.803221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:21.803974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:21.810178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.810786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.811323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:21.812094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.812626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.813253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:21.974384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:21.975337 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:21.982623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.983119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.983554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:21.984452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:21.984959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:21.985475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:22.084706 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:22.093497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5f35f7ab-ee8e-4f06-9b63-068a77bb9bbe tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 200 len: 1466 microversion: 2.1 time: 0.125052 Sep 09 01:56:22.094653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 389/815] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:21 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 1466 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:22.100699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00901855-faa9-4125-875b-927658be9ccd", "name": "network-vif-deleted", "tag": "83e9b084-f05c-44c4-9172-e61d551a8835"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:22.103904 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:22.111656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:22.112634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:22.113288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:22.117140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-91ffdad7-9725-458b-8be9-27d6fc4b4f11 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.317355 Sep 09 01:56:22.119386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 427/816] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:21 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:22.132497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] Creating event network-vif-deleted:83e9b084-f05c-44c4-9172-e61d551a8835 for instance 00901855-faa9-4125-875b-927658be9ccd on hv-cinder-85221 Sep 09 01:56:22.138502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-0d038809-b4f8-4312-9be7-bd5c65d56098 req-78893e39-3c66-43e2-a131-f7737e64c633 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042029 Sep 09 01:56:22.139038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 390/817] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:22.527853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:22.529268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:22.535312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:22.535837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:22.536272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:22.536968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:22.537625 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:22.538046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:22.603780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:22.612299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-254112fd-d097-4964-99b8-9267070025a4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1612 microversion: 2.1 time: 0.088036 Sep 09 01:56:22.614115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 428/818] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:22 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:23.121044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.121777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: 00901855-faa9-4125-875b-927658be9ccd] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.128381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.128883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.129898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.130606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.131059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.131483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.142178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.142797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.147441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] HTTP exception thrown: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Request method failure captured: Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd HTTP/1.1 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptyaCAmKuxdV93bhtYJbYv4rqJ5x0w_r5SWUS4684TBJ2fVu57gzwqawQ42RNEFcQJL_6N3_bw5TSrLR8-6_WXuc0QhjIWtvRiq-0QBBHsBEGdt-ZGKZK-ILeom5L9geBDVm_-GlrvLOniHepN_n40swMjxeBS8UjNV_vFgqbYaD1k Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:56:23.149121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6b35000faf844d758c12de9938c235a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6b35000faf844d758c12de9938c235a8", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 3153c9ff011f4ab8958fc49795e6f8f1 Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. Sep 09 01:56:23.150652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '00901855-faa9-4125-875b-927658be9ccd'} Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:23.151528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. Sep 09 01:56:23.152943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:23.154312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.154420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Returning 404 to user: Instance 00901855-faa9-4125-875b-927658be9ccd could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:23.154530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.154530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.154697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fdf12c88-ca5a-4565-a245-b2f174729cf5 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd" status: 404 len: 111 microversion: 2.1 time: 0.034001 Sep 09 01:56:23.154794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.154794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.154794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.155047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 391/819] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/00901855-faa9-4125-875b-927658be9ccd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:23.158984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.159465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.165690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.166262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.166783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.167553 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.168076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.168566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.198185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:23.284477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-487bde90-1629-4510-bd6c-f041f5a8d9ba tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 204 len: 0 microversion: 2.1 time: 0.128794 Sep 09 01:56:23.286137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 392/820] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:23 2022] DELETE /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:56:23.296527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.297501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.304304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.305093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.305551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.306410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.306712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.307132 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.329456 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:23.338848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d5600bf6-7b6a-4291-8b4c-a8b6c6de555d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.200799 Sep 09 01:56:23.339435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 429/821] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:23.445292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.447821 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.454392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.455112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.455721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.456795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.457995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.458581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.459959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:23.467818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8c71512c-925f-428c-a925-d280bdc3bfa6 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.176243 Sep 09 01:56:23.468566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 393/822] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:23.489520 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-129a0709-8292-4a8e-9a27-2de3c0d2c3cb tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048485 Sep 09 01:56:23.490088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 430/823] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 01:56:23.559125 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.559732 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.565684 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.566171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.566634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.567331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.567783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.568207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.594058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:56:23.637227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.638146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.645112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.645708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.646177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.646946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.647662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.648147 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.675583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ad4db54e-affd-4631-986e-e38c36f688b3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 204 len: 0 microversion: 2.1 time: 0.119872 Sep 09 01:56:23.680726 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 394/824] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:56:23 2022] DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:56:23.684352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.685122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.685743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.686364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'fault' on Instance uuid ab363ee7-d833-4edb-95de-48d7e54bc297 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:23.688120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:23.689209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:23.696448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.696926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.697386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.698075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:23.698522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:23.698963 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:23.730681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:23.737883 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-173dd498-5940-43f1-81a6-49ded97f5602 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 200 len: 1331 microversion: 2.1 time: 0.104703 Sep 09 01:56:23.738501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 431/825] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:23.836093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:23.844074 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4a6401e6-99a2-45ca-87cd-56bc45a9f35b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1673 microversion: 2.1 time: 0.161665 Sep 09 01:56:23.844647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 395/826] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:23 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:24.156315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab363ee7-d833-4edb-95de-48d7e54bc297", "name": "network-vif-deleted", "tag": "717c9750-3986-4f89-9e30-f7755cacc204"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:24.166484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.166955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.167374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.178646 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] Creating event network-vif-deleted:717c9750-3986-4f89-9e30-f7755cacc204 for instance ab363ee7-d833-4edb-95de-48d7e54bc297 on hv-cinder-85221 Sep 09 01:56:24.183311 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-b9367248-5037-4998-8dfc-35ffb0af4a5b req-e23c7b97-9308-45c7-8642-d276ca1b979a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030658 Sep 09 01:56:24.183865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 432/827] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:24.364208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:24.364810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:24.371397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.371884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.372314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.372990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.373466 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.373886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.491541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:24.492253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:24.498515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.499036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.499469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.500153 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.500607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.501039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.503923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:24.512072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cef095e9-1294-4383-908f-cae10edef587 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.152244 Sep 09 01:56:24.512630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 396/828] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:24 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:24.632480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:24.640029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aaba81b8-a5aa-4801-b02e-377502eaaf7d tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1521 microversion: 2.1 time: 0.152828 Sep 09 01:56:24.640596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 433/829] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:24 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:24.761279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:24.761813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:24.767627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.768097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.768521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.769222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.769705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.770119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.782841 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 HTTP/1.1 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:56:24.784427 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 01:56:24.785920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'ab363ee7-d833-4edb-95de-48d7e54bc297'} Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:24.786807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 01:56:24.788211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:24.789497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:24.789497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-dd2d5c02-c8a3-4485-a550-57908772166e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 404 len: 111 microversion: 2.1 time: 0.028511 Sep 09 01:56:24.789497 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 397/830] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:24 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:24.794447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1692532e-1649-491c-b837-5b12608247b6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '.version_select at 0x7f87dbe88b80>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:24.813288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1692532e-1649-491c-b837-5b12608247b6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271149871" status: 202 len: 0 microversion: 2.1 time: 0.022518 Sep 09 01:56:24.813837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 434/831] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Sep 9 01:56:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271149871 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:24.871022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:24.871637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:24.877512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.877998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.878434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:24.879121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:24.879577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:24.879998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:25.075686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:25.079613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:25.085690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d8f77417-8ccc-4bbb-bd1d-327ad3164735 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1673 microversion: 2.1 time: 0.218792 Sep 09 01:56:25.086342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 398/832] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:24 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:25.481232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-23d0eb7e-7fa4-478d-ac9e-beef18d702f3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: .version_select at 0x7f87dbe7f790>, body: {"keypair": {"name": "tempest-keypair-1913107466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCZt/pPV8jyVu4gsud9zPcR7C+rd5jnERASP/GVocfaMo09M0IXmKxvWtXFiMT435o5wloJ8RYyfdPLvnIaAZM3T5/IdebdG6MQfeKrqXqWiPGkyJKHlnmZV/5xMnPA2w=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:25.499192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-23d0eb7e-7fa4-478d-ac9e-beef18d702f3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:25.503754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-23d0eb7e-7fa4-478d-ac9e-beef18d702f3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:25.530296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-23d0eb7e-7fa4-478d-ac9e-beef18d702f3 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052938 Sep 09 01:56:25.531092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 435/833] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:56:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:25.536792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:25.537435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:25.550583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:25.551314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:25.552007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:25.552932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:25.553498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:25.554001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:25.661872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:25.662497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:25.675689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:25.677140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:25.678177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:25.680047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:25.681195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:25.682255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:25.843208 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3153c9ff011f4ab8958fc49795e6f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b35000faf844d758c12de9938c235a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:25.857756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b2e1fb48-ce2e-42be-9590-be14e0fd5070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 200 len: 1479 microversion: 2.1 time: 0.199564 Sep 09 01:56:25.869155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 436/834] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:25 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 1479 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:25.990185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:26.000224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8adfb3f7-df8c-4ac7-babf-d9d606fedc3a tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.468233 Sep 09 01:56:26.000794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 399/835] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:25 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:26.111288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:26.112592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:26.122132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:26.122897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:26.123491 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:26.125161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:26.125874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:26.126473 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:26.209121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10c908e-1792-46e9-ae0a-6727f8bf4923", "name": "network-vif-deleted", "tag": "11b14534-43ce-4d43-b397-4294269046b0"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:26.220859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:26.221413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:26.221836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:26.233647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] Creating event network-vif-deleted:11b14534-43ce-4d43-b397-4294269046b0 for instance f10c908e-1792-46e9-ae0a-6727f8bf4923 on hv-cinder-85221 Sep 09 01:56:26.238514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-dbd5ea73-9c80-418a-88c3-74d1dd65562a req-39337762-89ff-4155-a36e-cae751e85e61 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Sep 09 01:56:26.239251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 400/836] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:26.395619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:26.403916 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2cdec318-4c11-4952-bdea-8a6b69dad006 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1673 microversion: 2.1 time: 0.297576 Sep 09 01:56:26.404501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 437/837] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:26 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1673 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:26.885275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:26.907181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] [instance: f10c908e-1792-46e9-ae0a-6727f8bf4923] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:26.917338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:26.917920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:26.918448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:26.919235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:26.919898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:26.927832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:26.942931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] HTTP exception thrown: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Request method failure captured: Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 HTTP/1.1 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGptyaCAmKuxdV93bhtYJbYv4rqJ5x0w_r5SWUS4684TBJ2fVu57gzwqawQ42RNEFcQJL_6N3_bw5TSrLR8-6_WXuc0QhjIWtvRiq-0QBBHsBEGdt-ZGKZK-ILeom5L9geBDVm_-GlrvLOniHepN_n40swMjxeBS8UjNV_vFgqbYaD1k Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:56:26.945996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6b35000faf844d758c12de9938c235a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6b35000faf844d758c12de9938c235a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6b35000faf844d758c12de9938c235a8", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 6b35000faf844d758c12de9938c235a8 Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-477689416 Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 3153c9ff011f4ab8958fc49795e6f8f1 Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-ServerRescueNegativeTestJSON-477689416-project Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. Sep 09 01:56:26.947996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'f10c908e-1792-46e9-ae0a-6727f8bf4923'} Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:26.948836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. Sep 09 01:56:26.950146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:56:26.952241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] Returning 404 to user: Instance f10c908e-1792-46e9-ae0a-6727f8bf4923 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:26.953468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f6773a29-ab3b-4b03-abd8-f74401c51070 tempest-ServerRescueNegativeTestJSON-477689416 tempest-ServerRescueNegativeTestJSON-477689416-project] 10.222.0.15 "GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923" status: 404 len: 111 microversion: 2.1 time: 0.074028 Sep 09 01:56:26.954550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 401/838] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:26 2022] GET /compute/v2.1/servers/f10c908e-1792-46e9-ae0a-6727f8bf4923 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:27.021361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1010574826", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3840bd6e-907e-4191-be2d-5f3b8f05d0c8"}], "security_groups": [{"name": "tempest-securitygroup--775281134"}], "key_name": "tempest-keypair-1913107466", "user_data": "}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:27.029697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:27.030865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:27.038245 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.039489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.040162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.041279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.042008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.042700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.230560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] validate_networks() for [('3840bd6e-907e-4191-be2d-5f3b8f05d0c8', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:56:27.323484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:27.331581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a8a45558-cf70-4514-8553-683623144280 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.306325 Sep 09 01:56:27.332903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 402/839] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:27 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:27.428102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:27.429209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:27.438767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.439271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.439714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.442338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.443736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.444184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.492806 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.493489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.493762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.494210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lazy-loading 'fault' on Instance uuid 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:56:27.573446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:27.585342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-666a736e-491e-4ecf-af9f-5b8e27550cb4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 200 len: 1326 microversion: 2.1 time: 0.161201 Sep 09 01:56:27.587849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 403/840] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:27 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:27.781881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:56:27.782324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:56:27.782827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:56:27.783238 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:56:27.783647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:56:27.795452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.799913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.800364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.802090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:27.802552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:27.803199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:27.820868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:27.825432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:27.838035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:56:27.840475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:56:27.892210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-801d9faa-a15d-4a63-b8cf-da8227092bd7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.876378 Sep 09 01:56:27.899521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 438/841] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:56:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:56:27.905417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9b0f3943-f200-4a87-a21c-077a9be3ed16 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:27.906102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9b0f3943-f200-4a87-a21c-077a9be3ed16 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:27.988831 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9b0f3943-f200-4a87-a21c-077a9be3ed16 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:27.998879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9b0f3943-f200-4a87-a21c-077a9be3ed16 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1242 microversion: 2.1 time: 0.097060 Sep 09 01:56:28.013683 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 404/842] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:27 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:28.258496 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d", "name": "network-vif-deleted", "tag": "bd3cd99c-b16b-4f0a-8889-0a455d3fb939"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:28.271393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:28.273849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:28.274995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:28.291503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] Creating event network-vif-deleted:bd3cd99c-b16b-4f0a-8889-0a455d3fb939 for instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d on hv-cinder-85221 Sep 09 01:56:28.296920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-599aa6e9-5e95-4428-824e-e3bc96b52529 req-17205411-5d11-48d9-9d0c-55efa175f949 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041618 Sep 09 01:56:28.298116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 439/843] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:28.355221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:28.356018 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:28.362992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:28.364050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:28.364895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:28.365813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:28.366630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:28.367560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:28.508196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:28.516736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a4444525-fea0-423e-acf1-9ecdd46cbf5d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.165527 Sep 09 01:56:28.517332 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 405/844] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:28 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:28.612517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:28.613772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:28.621501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:28.621991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:28.622441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:28.623110 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:28.623559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:28.624174 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:28.641782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d HTTP/1.1 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:56:28.643460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:56:28.645616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d'} Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:56:28.646619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:56:28.648016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:56:28.649946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:56:28.650959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d78632bd-a804-4cfc-94dc-5f23177879aa tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 404 len: 111 microversion: 2.1 time: 0.043303 Sep 09 01:56:28.654171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 440/845] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:28 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:56:28.663137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9b2dea5a-66ab-42c5-a847-a4b5e2dbe44c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '.version_select at 0x7f87dbe3bb80>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:28.690774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9b2dea5a-66ab-42c5-a847-a4b5e2dbe44c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-355746002" status: 202 len: 0 microversion: 2.1 time: 0.031814 Sep 09 01:56:28.692571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 406/846] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 01:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-355746002 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 01:56:29.023754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:29.024449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:29.030389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:29.030871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:29.031486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:29.032173 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:29.032622 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:29.033083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:29.105398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:29.113910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9025bf9e-33ea-4ef1-a194-c5ff2d6bbd4b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1294 microversion: 2.1 time: 0.094082 Sep 09 01:56:29.114487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 441/847] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:29 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:29.542019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:29.542595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:29.552522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:29.553301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:29.553889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:29.554742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:29.555611 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:29.556289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:29.823973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:29.834441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4351e5c1-59ce-4d95-bfc9-c42f1089a4fc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.297460 Sep 09 01:56:29.835739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 407/848] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:29 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:30.051815 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2af87812-6b16-45e5-87f7-5150733d9ddc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: .version_select at 0x7f87d86b0940>, body: {"keypair": {"name": "tempest-keypair-672822623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzH1UyAVAXRym6cBfV3oQ37fLzdFsso12KAzz9ROBYBt6hqSK6UfmlGMGX8KMHvvYuoJi55Z4f5fkAe3JCXJY9zridFHNiLvBV+tneuGgoFQypQzlvtYzQ9qDnQUOxzBQ=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:30.067855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-2af87812-6b16-45e5-87f7-5150733d9ddc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:30.071726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-2af87812-6b16-45e5-87f7-5150733d9ddc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for user 83f9dc8c41604f0e86eaf57202285cc4 and project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:30.096164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2af87812-6b16-45e5-87f7-5150733d9ddc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048373 Sep 09 01:56:30.103047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 442/849] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:56:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:30.137932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:30.138657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:30.146867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:30.147355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:30.147939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:30.149840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:30.150310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:30.150743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:30.228045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:30.240594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1b5435ef-f1e1-4a42-909e-b80f176a011a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1300 microversion: 2.1 time: 0.107152 Sep 09 01:56:30.243180 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 408/850] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:30 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:30.860694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:30.862211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:30.874467 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:30.874963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:30.875398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:30.876101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:30.882728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:30.883324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:31.264593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:31.267720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:31.268408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:31.274568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ca6d0b76-7fba-4ddb-bb0c-d80bab583742 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.418924 Sep 09 01:56:31.301404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 443/851] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:30 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:31.301640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:31.301640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:31.301640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:31.301640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:31.302012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:31.302012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:31.580082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:31.588003 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-31eeeb25-4c41-4fb9-9c50-4f7115f33adc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.327479 Sep 09 01:56:31.588576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 409/852] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:31 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:32.123954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f74eb0-9fbe-4196-9a06-a6fd8975a76b", "tag": "e989a7b5-3021-4074-b660-80d53ef9d5a6"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:32.129918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:32.136756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:32.137201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:32.137626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:32.150023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] Creating event network-changed:e989a7b5-3021-4074-b660-80d53ef9d5a6 for instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b on hv-cinder-85221 Sep 09 01:56:32.155145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-e0f57914-b0ae-4004-88f2-29f875811c5e req-f7d00b13-b45f-45c9-a3aa-ad3f70204801 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034474 Sep 09 01:56:32.155776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 444/853] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:32.311715 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:32.313770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:32.322615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:32.323792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:32.324845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:32.325967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:32.326694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:32.327174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:32.612822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:32.614920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:32.623760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:32.624938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:32.625634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:32.626353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:32.626820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:32.627444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:32.637120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:32.646409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1fbbab6a-7cf5-477e-a608-7502d8fbe69f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.340172 Sep 09 01:56:32.657921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 410/854] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:32 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:32.976120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:32.986004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ea486033-fbff-45fa-9408-d2b55fc621a0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.378592 Sep 09 01:56:32.987701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 445/855] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:32 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:33.122052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1508915307", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "925a2cfe-0749-4777-b934-d3107264ee82"}], "security_groups": [{"name": "tempest-securitygroup--434694583"}], "key_name": "tempest-keypair-672822623", "user_data": "}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:33.232230 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] validate_networks() for [('925a2cfe-0749-4777-b934-d3107264ee82', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:56:33.648376 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:56:33.649551 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:56:33.650420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:56:33.650988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:56:33.651742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:56:33.666400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:33.666400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:33.666400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:33.667779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:33.668491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:33.669045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:33.671484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:33.672158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:33.680091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:33.680797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:33.681403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:33.682262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:33.682868 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:33.683436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:33.692570 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:33.697818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Getting quotas for user 83f9dc8c41604f0e86eaf57202285cc4 and project 1ed13a0f61d34a80898093dc1d8e6610. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:33.708611 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:33.710176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:33.713097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:56:33.715910 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:56:33.780731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e94b8b44-a27f-4365-ba40-7af9d01ff3c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663135 Sep 09 01:56:33.788137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 411/856] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:56:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:56:33.793698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e07f1d5a-3d2f-424d-8366-1bcfc4eaf065 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:33.794555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e07f1d5a-3d2f-424d-8366-1bcfc4eaf065 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:33.868909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e07f1d5a-3d2f-424d-8366-1bcfc4eaf065 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:33.877442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e07f1d5a-3d2f-424d-8366-1bcfc4eaf065 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1237 microversion: 2.1 time: 0.088182 Sep 09 01:56:33.877930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:33.878367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 412/857] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:33 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:33.892768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8b295440-61fe-4950-8aa8-9adc189d27d8 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.219039 Sep 09 01:56:33.892768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 446/858] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:33 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:34.010766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:34.011953 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:34.019959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.020722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.021412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:34.022348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.023038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.023655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:34.201152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:34.210329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-09b3ec85-c116-445c-b73f-67c90486c96d tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.203514 Sep 09 01:56:34.211832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 413/859] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:34 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:34.906211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:34.907342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:34.915228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:34.916585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:34.921269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.921778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.922214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:34.922906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.923354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.923770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:34.924143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.924766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.925342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:34.926792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:34.930908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:34.931733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:35.004425 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:35.016112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-906c6519-42f6-4090-809b-951940bf78ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1241 microversion: 2.1 time: 0.116715 Sep 09 01:56:35.017368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 447/860] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:34 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:35.118499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:35.126727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e62d3b00-4248-41e5-ac03-3a8f7c5a18e7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.215403 Sep 09 01:56:35.127306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 414/861] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:34 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:35.235234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:35.236251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:35.244494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:35.245373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:35.246237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:35.247905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:35.248478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:35.248998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:35.991519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:36.003441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-79051669-614c-4f16-a12c-9e6a8c01386c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.771880 Sep 09 01:56:36.005022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 448/862] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:35 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:36.039115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:36.040450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:36.047749 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:36.049185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:36.049909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:36.051823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:36.052343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:36.052775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:36.129855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:36.138310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ddf2ba7a-35dd-4e7b-ad9c-9e8bbb40dcf8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1289 microversion: 2.1 time: 0.103779 Sep 09 01:56:36.139471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 415/863] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:36 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:36.152170 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:36.156189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:36.162328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:36.163086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:36.163721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:36.164599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:36.165334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:36.166532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:36.697419 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:36.709246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-db392917-152b-41a2-8756-a5389090b55c tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.560636 Sep 09 01:56:36.712588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 449/864] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:36 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:37.029233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:37.029865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:37.040334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.045408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.046076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:37.046988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.047958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.048584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:37.161739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:37.163236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:37.172070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.173703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.174519 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:37.175532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.176226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.178680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:37.299879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:37.309074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-459d7c0d-7441-4e59-a34e-dd85957b1049 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1295 microversion: 2.1 time: 0.151691 Sep 09 01:56:37.322028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 450/865] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:37 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:37.459417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:37.483369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4ddbdff5-e660-4f02-a958-51bb14931c0e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.450876 Sep 09 01:56:37.494734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 416/866] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:37 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:37.690192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a5ee24a4-dc2e-4567-8dea-e96eae19f945 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: .version_select at 0x7f87dbe8c700>, body: {"keypair": {"name": "tempest-keypair-196313835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV9X4RPkIOp1dZIb7UQkyCe9mrHXtLNSd67pg5Mv96fPomx7cCkRS8vsQcDCBOU3F78Ir7kV81UFZHOen+TcyuIaGMOzIHS51MYl486ODYRKXReZCsGVhxmvl3PxUrVqg=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:37.707307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-a5ee24a4-dc2e-4567-8dea-e96eae19f945 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for project d2f935cd526946779ecce236c9d47f3f. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:37.712008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-a5ee24a4-dc2e-4567-8dea-e96eae19f945 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for user eaaf03c8c05d4f598328ef5c05974e5e and project d2f935cd526946779ecce236c9d47f3f. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:37.738167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:37.739744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:37.746193 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a5ee24a4-dc2e-4567-8dea-e96eae19f945 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.300287 Sep 09 01:56:37.754341 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.755129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 451/867] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Sep 9 01:56:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 310 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 01:56:37.756191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.756871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:37.757896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:37.758586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:37.759897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:38.093750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:38.104105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9d41ce24-c305-41a4-a593-4a0c16e296e5 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.371444 Sep 09 01:56:38.121127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 417/868] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:37 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:38.335927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:38.337631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:38.348299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:38.352319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:38.354052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:38.355120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:38.357679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:38.358408 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:38.360052 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:38.510348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:38.510967 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:38.525547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:38.526100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:38.526555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:38.528435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:38.528903 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:38.529358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:38.845355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:38.854452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-66232315-9443-441b-ab39-63389a9d40da tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.526432 Sep 09 01:56:38.882438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 452/869] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:38 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:38.981538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:38.997267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6d7261f1-e219-437d-8a25-34fa1025e362 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.491051 Sep 09 01:56:39.010054 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 418/870] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:38 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:39.131427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:39.132137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:39.141587 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:39.144849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:39.145614 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:39.146504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:39.149589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:39.150327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:39.382387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:39.390432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-85bc6f93-4d81-4fd2-a8ff-e66a4f5dd64b tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.262931 Sep 09 01:56:39.400299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 453/871] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:39 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:39.573407 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-982184156", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52c17b8d-9cbf-4b19-b734-8dfd42851345"}], "security_groups": [{"name": "tempest-securitygroup--514955338"}], "key_name": "tempest-keypair-196313835", "user_data": "}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:39.818911 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f74eb0-9fbe-4196-9a06-a6fd8975a76b", "name": "network-vif-plugged", "status": "completed", "tag": "e989a7b5-3021-4074-b660-80d53ef9d5a6"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:39.830327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:39.830966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:39.832370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:39.845988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] Creating event network-vif-plugged:e989a7b5-3021-4074-b660-80d53ef9d5a6 for instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b on hv-cinder-85221 Sep 09 01:56:39.852907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-697c6771-b198-455d-82a5-2459be01ab3a req-fb4add42-7457-41e6-adc5-51312b4fc360 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Sep 09 01:56:39.854078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 454/872] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:39.886620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:39.889682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:39.899242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:39.899878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:39.900405 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:39.901616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:39.902185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:39.902695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.146335 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] validate_networks() for [('52c17b8d-9cbf-4b19-b734-8dfd42851345', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:56:40.372341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:40.382420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-606d90e1-b854-422c-8ff0-f7be1f31c986 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.499902 Sep 09 01:56:40.404120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 455/873] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:39 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:40.410408 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:40.411023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:40.417685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.418179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.418612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.419310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.419772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.420190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.716034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:40.725673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c889304c-5195-4f18-a047-69f3dd1ac1ec tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.319319 Sep 09 01:56:40.727124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 456/874] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:40 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:40.741233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:40.741233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:40.747872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.748440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.748939 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.749733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.750364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.750932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.969735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:56:40.971041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:56:40.971529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:56:40.972586 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:56:40.973000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:56:40.981133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:40.983216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.983722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.984151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.985453 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:40.985917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:40.986406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:40.989804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-741ff504-fc1c-472b-8b30-7b952686274e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.261593 Sep 09 01:56:40.992507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 457/875] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:40 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:40.996439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875530d8-7896-4c8d-ad2b-ec715b49421d", "tag": "fe022ad1-e9fa-447d-a522-14b9d96efbbe"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:41.010142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:41.010937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:41.011367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:41.011920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for project d2f935cd526946779ecce236c9d47f3f. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:56:41.018244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for user eaaf03c8c05d4f598328ef5c05974e5e and project d2f935cd526946779ecce236c9d47f3f. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:56:41.025315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] Creating event network-changed:fe022ad1-e9fa-447d-a522-14b9d96efbbe for instance 875530d8-7896-4c8d-ad2b-ec715b49421d on hv-cinder-85221 Sep 09 01:56:41.030284 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-a03f5f3c-b25b-4aa4-b6bb-d1eafef44f31 req-18ff79db-ecfb-4991-9ce1-154ec1a1f076 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038141 Sep 09 01:56:41.030717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 458/876] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:41.033171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:56:41.035381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:56:41.084196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5b676756-34e0-4c73-b1fe-7390b43d6b71 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.515402 Sep 09 01:56:41.085034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 419/877] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Sep 9 01:56:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 01:56:41.096635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:41.097432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:41.156805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:41.168055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:41.170041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:41.172191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dde88b3b-71f9-4b89-8654-f56a7e9bb5f3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1280 microversion: 2.20 time: 0.079080 Sep 09 01:56:41.173571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 459/878] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:41 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:56:41.406597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:41.407210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:41.416843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:41.417668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:41.418272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:41.419163 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:41.420362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:41.420964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:41.616703 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:41.620879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=100 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:41.626279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-867b73b4-8678-4fb9-8b84-688746909858 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.224806 Sep 09 01:56:41.641827 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 420/879] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:41 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:41.749638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:41.750439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:41.758723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:41.759504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:41.759945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:41.760796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:41.761291 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:41.761713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:41.900368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:41.908341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fec676bf-7732-48e4-992a-d2bedd2d2c76 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.162738 Sep 09 01:56:41.908919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 460/880] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:41 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:42.018518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:42.019207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:42.025468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.025959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.026396 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.027087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.027541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.027965 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.174505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:42.182383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b2cb1d2a-b181-4d23-a26d-0aeebffe5f5e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.168097 Sep 09 01:56:42.182952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 421/881] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:42 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:42.197667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:42.198281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:42.204272 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.204751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.205225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.205912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.207039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.207464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.266518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:42.275064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:42.276510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:42.277632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fa8324de-82e7-42cb-b942-b9f4dabeb3a9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1284 microversion: 2.20 time: 0.083810 Sep 09 01:56:42.278196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 461/882] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:42 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:42.648129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:42.648734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:42.655134 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.655612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.656041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.656718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.657259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.657679 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.783719 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:42.791918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8638e8b9-a4a7-4247-a935-8e9f0d5c11ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.148127 Sep 09 01:56:42.792483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 422/883] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:42 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:42.931231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:42.931840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:42.938084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.938565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.938990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:42.939670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:42.940116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:42.940529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.078957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:43.087343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5c50da5d-9b3c-40a0-a3b7-cf0e19d267ac tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1367 microversion: 2.1 time: 0.159527 Sep 09 01:56:43.088126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 462/884] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:42 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:43.205422 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:43.206034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:43.212084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.212567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.213155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.213722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.214175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.214667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.309568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:43.318905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:43.340151 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.340667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.342289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.343080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.345768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.346478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.371351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:43.388130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-68ee7325-4a07-4e07-835d-a8626326d131 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.186350 Sep 09 01:56:43.390016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 423/885] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:43 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:43.449258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:43.457278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:43.458706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:43.459833 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c049aa53-7f2e-4921-8469-b1507cf4cd59 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1332 microversion: 2.20 time: 0.161196 Sep 09 01:56:43.460394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 463/886] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:43 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1332 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:56:43.814367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:43.815126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:43.825399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.826152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.826785 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:43.828089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:43.828760 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:43.829449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.020030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.027653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-74d97408-eb51-4ce6-ac58-ac2f5e1ebcfe tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.217515 Sep 09 01:56:44.028220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 424/887] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:43 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:44.111045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:44.111678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.118806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.119295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.119728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.120414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.120866 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.121318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.294346 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.302646 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-50e7d72f-ebb6-4af9-887b-af9b537a8c51 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1557 microversion: 2.1 time: 0.195425 Sep 09 01:56:44.303233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 464/888] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:44 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:44.326575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:44.327115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.333268 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.333755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.334411 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.335287 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.336022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.336604 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.416189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:44.416809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.423615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.424437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.425299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.426023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.426482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.426903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.539447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-29102b2b-f3ee-4689-84e4-6d3f17768dff tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216976 Sep 09 01:56:44.548669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 425/889] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:56:44 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:44.555508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:44.556122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.564830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.566051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.566731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.567894 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.568960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.569568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.678636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.687555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.688985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.690520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-99923ab2-a46a-4987-a976-d4cbe8fe9747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1338 microversion: 2.20 time: 0.139325 Sep 09 01:56:44.691236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 426/890] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:44 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:44.745422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:44.758203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c4a58270-14c5-414d-91e4-454366bc5fc2 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1571 microversion: 2.1 time: 0.345770 Sep 09 01:56:44.758849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 465/891] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:44 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1571 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:44.780812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:44.781468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.788063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.788550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.788984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.789712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.790168 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.790588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.838576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126896) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 01:56:44.910811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4aac108e-6e69-4bd7-af93-857264b9c9ea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "POST /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b/action" status: 202 len: 0 microversion: 2.1 time: 0.133857 Sep 09 01:56:44.911667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 427/892] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 01:56:44 2022] POST /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:56:44.920093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:44.920709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:44.931752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.932415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.932816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.933633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:44.934180 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:44.934655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:44.951496 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:45.051182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:45.052009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:45.061355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.066050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.066581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.067441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.067997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.068496 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.202897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:45.212127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1e1f8736-f39a-4322-97df-87ea1c3120a0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1579 microversion: 2.1 time: 0.296086 Sep 09 01:56:45.213047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 466/893] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:44 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1579 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:45.353525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:45.366754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e14dc304-748c-4d5e-9233-e7c930c23c84 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.319750 Sep 09 01:56:45.367713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 428/894] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:45 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:45.641400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f74eb0-9fbe-4196-9a06-a6fd8975a76b", "tag": "e989a7b5-3021-4074-b660-80d53ef9d5a6"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:45.653031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.653680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.654205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.667433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] Creating event network-changed:e989a7b5-3021-4074-b660-80d53ef9d5a6 for instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b on hv-cinder-85221 Sep 09 01:56:45.672997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-5742bfdd-c71f-41c5-abcf-6c1206e8e4a8 req-ad0025a4-535e-4531-8c3c-422f21210fa0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036345 Sep 09 01:56:45.678572 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 467/895] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:45.719627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:45.722345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:45.744373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.745539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.746141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.747049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.747668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.748250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.917977 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "name": "network-vif-unplugged", "status": "completed", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:45.929488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:45.930526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:45.931137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:45.947511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.compute.server_external_events [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] Unable to find a host for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b. Dropping event network-vif-unplugged {{(pid=126895) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 01:56:45.949034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-859bad7d-53c5-4a24-9805-acbd507b20b0 req-afb2338a-3db6-4fda-8d66-80c8459eebcc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035558 Sep 09 01:56:45.950300 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 468/896] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 01:56:45.980487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:45.988947 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:45.990430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:45.991565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8ac5a832-32f4-4929-9312-24393ce35ec9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.279467 Sep 09 01:56:45.992380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 429/897] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:45 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:46.236345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:46.237141 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:46.244747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:46.245260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:46.245693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:46.246397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:46.246854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:46.247273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:46.397720 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:46.398349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:46.404962 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:46.405776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:46.406491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:46.407478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:46.408091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:46.408670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:46.713344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:46.721337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d066f81c-848b-42f0-815c-e4208191e8f3 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1519 microversion: 2.1 time: 0.488789 Sep 09 01:56:46.722426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 469/898] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:46 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:46.787611 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:46.795501 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8327d4b5-afef-4033-9b59-37df825f97ad tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.405226 Sep 09 01:56:46.796069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 430/899] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:46 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:47.017099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:47.017635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:47.023574 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.024055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.024488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:47.025204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.025658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.026077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:47.159051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:47.167196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:47.168711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:47.169931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0b44072e-aea4-4b0e-a5c9-9187a64f8df3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.156868 Sep 09 01:56:47.170483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 470/900] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:47 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:47.745035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:47.745849 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:47.751942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.752418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.753561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:47.754248 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.754704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.755125 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:47.819382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:47.820649 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:47.827606 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.828091 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.828652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:47.829371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:47.829817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:47.830395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:48.127303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:48.135665 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-beb0591f-37a5-4f37-ae46-efae718a33b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1521 microversion: 2.1 time: 0.394566 Sep 09 01:56:48.136243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 431/901] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:47 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:48.169636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:48.178500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-0080ee17-3307-4ad2-bb50-dba63229f3a3 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.363237 Sep 09 01:56:48.179075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 471/902] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:47 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:48.195843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:48.196449 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:48.202514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:48.203355 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:48.204152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:48.205000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:48.205632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:48.206437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:48.532984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:48.541651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:48.543972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:48.544699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d9b8feeb-5496-48cd-9cb1-d92b26b52689 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.353073 Sep 09 01:56:48.545435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 432/903] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:48 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:48.711454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:48.721037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:48.721552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:48.722653 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:48.733304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] Creating event network-changed:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 01:56:48.738168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-1384a49b-94c0-4b53-9664-209cb5e3ea89 req-686a63ad-39bb-4543-a355-3dc941670758 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030582 Sep 09 01:56:48.738847 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 472/904] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:56:49.160663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:49.161340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:49.167681 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.168165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.168597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.169307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.169780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.170189 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.203316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:49.204018 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:49.210518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.211008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.211444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.212258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.212835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.213289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.566136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:49.573957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-482f968d-34f0-4d38-905a-0b634e2e85ce tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.417659 Sep 09 01:56:49.574619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 433/905] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:49 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:49.579184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:49.579949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:49.586107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.586661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.587310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.588190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.588650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.589089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.593885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:49.605390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-559036a4-7b04-4d2f-9764-91952d4ac722 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.406670 Sep 09 01:56:49.605972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 473/906] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:49 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:49.803945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875530d8-7896-4c8d-ad2b-ec715b49421d", "name": "network-vif-plugged", "status": "completed", "tag": "fe022ad1-e9fa-447d-a522-14b9d96efbbe"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:49.814254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:49.814799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:49.815793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:49.827685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] Creating event network-vif-plugged:fe022ad1-e9fa-447d-a522-14b9d96efbbe for instance 875530d8-7896-4c8d-ad2b-ec715b49421d on hv-cinder-85221 Sep 09 01:56:49.833345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-a51e1632-9128-407d-8a80-6c8becf9c54d req-f207e24a-7a3b-4b82-8ba6-ace06e7e7c0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 Sep 09 01:56:49.834031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 474/907] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:49.894652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:49.903853 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:49.905384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:49.906491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b994e7cc-fb78-4036-a0c9-de15d26d2e2b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.330899 Sep 09 01:56:49.907040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 434/908] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:49 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:50.599805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:50.600499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:50.606517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.606995 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.607423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:50.608096 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.608540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.608955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:50.628377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:50.628987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:50.635592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.636084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.636522 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:50.637257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.637722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.638147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:50.812867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:50.816821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:50.821264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dd3d3e52-10a2-4e7a-8bc2-9fa54cf45b55 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.226620 Sep 09 01:56:50.821842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 475/909] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:50 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:50.824708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-441b9df3-2c9c-42b1-9208-536f603846d7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.200641 Sep 09 01:56:50.825302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 435/910] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:50 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:50.931776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:50.932417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:50.938354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.938833 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.939262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:50.939942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:50.941024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:50.941482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:51.068869 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:51.077112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:51.078546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:51.079681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ad95d65f-676e-4ff4-a326-ffee94cbb978 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.151850 Sep 09 01:56:51.080241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 476/911] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:50 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:51.844877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:51.845517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:51.848044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=4 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:51.848191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:51.848721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=16 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:51.848829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:51.850781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=20 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:51.855554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:51.856051 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:51.856575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:51.856705 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:51.857145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:51.857273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:51.857576 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:51.857698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:51.858281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:51.858401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:51.858708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:51.859113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:52.053158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:52.056585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:52.060033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:52.061152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d6726d0d-1651-4f74-9fe9-e6f022fd9e38 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.217233 Sep 09 01:56:52.061558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 477/912] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:51 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:52.066312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e9feecd1-76da-4544-b25d-7b7eeafd3aed tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.225316 Sep 09 01:56:52.066872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 436/913] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:51 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:52.109845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:52.110387 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:52.116237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:52.116723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:52.117449 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:52.118130 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:52.118579 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:52.118992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:52.244699 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:52.253140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:52.254559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:52.255644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6f922f8a-ad7c-4305-b713-d49c6ae858a6 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.149549 Sep 09 01:56:52.256190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 478/914] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:52 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:53.084415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:53.085017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:53.089190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:53.089805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:53.093109 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.093630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.094092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.094773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.095220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.095636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.096481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.096970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.097446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.098140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.098598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.099017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.287980 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:53.291595 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:53.295670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4b276d9d-62c6-42bd-aad6-f9a850dfd6e6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.215807 Sep 09 01:56:53.296246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 437/915] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:53 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:53.299483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d1a97497-90b3-48c9-9233-3a28b4754367 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.214318 Sep 09 01:56:53.300370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 479/916] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:53 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:53.300697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:53.301515 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:53.307198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.307676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.308107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.309456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:53.309915 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:53.310337 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:53.440061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:53.448478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:53.449948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:53.451042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-db7ba92f-0142-4e03-beb3-b3039bfab8cb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.153868 Sep 09 01:56:53.451605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 438/917] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:53 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:54.318518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:54.319125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:54.321860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:54.322475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:54.325637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.326118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.326545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.327429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.327879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.328293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.328863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.329382 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.329824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.330677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.331554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.331983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.528350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:54.533920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:54.536275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-396bfbd1-fb4c-4cc0-bdee-29afb9539837 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.222020 Sep 09 01:56:54.536840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 480/918] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:54 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:54.541514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:54.542007 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-65be8500-e17a-422c-ac5e-2b7b14cce22e tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.223941 Sep 09 01:56:54.542304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:54.542743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 439/919] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:54 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:54.549099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.549585 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.550013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.550813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:54.551268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:54.551682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:54.678547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:54.686388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:54.687805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:54.688888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9925bd66-beaa-4087-b00c-a360bd6dee1e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.151119 Sep 09 01:56:54.689471 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 481/920] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:54 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:55.560992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:55.561549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:55.564324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:55.564942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:55.568327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.568525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.568955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.569673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.570123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.570545 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.571300 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.571791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.572223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.572913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.573403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.573831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.767516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:55.776233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-955b021a-513b-43f8-b12d-4394c157c39b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1362 microversion: 2.1 time: 0.219189 Sep 09 01:56:55.776941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 440/921] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:55 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:55.782201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:55.782889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:55.789487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.790217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.790717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.791485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:55.792032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:55.792524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:55.797253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:55.805710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f7665e5a-1abf-4383-b945-e4ff1674b0e1 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.245288 Sep 09 01:56:55.806826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 482/922] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:55 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:55.929220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:55.938565 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:55.940885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:55.942070 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-de95a499-7da2-4344-b2d4-192182ec8c18 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.163946 Sep 09 01:56:55.942739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 441/923] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:55 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:56.804677 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:56.805244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:56.811565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:56.812045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:56.812478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:56.813308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:56.813768 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:56.814186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:56.829365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:56.829988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:56.837779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:56.838495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:56.839129 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:56.840160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:56.840844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:56.841546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:57.016703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:57.021152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:57.024598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f3823258-ab1c-4437-9ea3-e812cb5c0247 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1548 microversion: 2.1 time: 0.223797 Sep 09 01:56:57.025312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 483/924] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:56 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1548 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:57.029330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a7e0431e-34c6-4ea8-8240-b0ea634f05c0 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.203676 Sep 09 01:56:57.029737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:57.030107 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 442/925] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:56 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:57.030342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:57.036218 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:57.036698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:57.037168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:57.037861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:57.038317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:57.038745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:57.047474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:57.047965 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:57.054338 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:57.054877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:57.055291 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:57.055979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:57.056435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:57.056857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:57.167947 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-990f6642-e622-456d-a521-a62fd248fdbc tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124078 Sep 09 01:56:57.168872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 443/926] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:56:57 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:57.205401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:57.213636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:57.215078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:57.216186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-14e9355a-45f8-4d2e-9385-7a4c5210dc85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.189951 Sep 09 01:56:57.216747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 484/927] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:57 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:58.047811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "name": "network-vif-plugged", "status": "completed", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:58.052262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:58.053331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:58.057929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.058979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.059666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.060067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.060757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.061475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.062457 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.063081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.063659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.077759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] Creating event network-vif-plugged:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 01:56:58.083669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-d1e5a8ab-4862-411f-a6cd-f6a711ec2e5e req-74961b3d-7e02-49c6-9fa7-d4a93cf6e49a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040398 Sep 09 01:56:58.084694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 444/928] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:58.213635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:58.226915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:56:58.231966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ab57c0c9-ed12-4612-b43f-6a87bca5ba40 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.183970 Sep 09 01:56:58.232554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 485/929] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:58 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:56:58.242787 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:58.243490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:58.249671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.250167 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.250602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.251292 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.251739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.252333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.363630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875530d8-7896-4c8d-ad2b-ec715b49421d", "tag": "fe022ad1-e9fa-447d-a522-14b9d96efbbe"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:56:58.375466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:58.376314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:58.376751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:58.393566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] Creating event network-changed:fe022ad1-e9fa-447d-a522-14b9d96efbbe for instance 875530d8-7896-4c8d-ad2b-ec715b49421d on hv-cinder-85221 Sep 09 01:56:58.400432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-868516d0-d074-4410-83ad-a138a5995c7c req-b292b1be-0089-43ea-a08d-41e996213a22 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041962 Sep 09 01:56:58.403980 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 486/930] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:56:58.550851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:58.559332 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:58.560771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:58.561906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cd5e18a6-b68e-42f6-a13e-f429ae71597b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.323693 Sep 09 01:56:58.562470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 445/931] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:58 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:56:59.258545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:59.259256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:59.265679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:59.266167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:59.266600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:59.267290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:59.267745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:59.268803 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:59.404008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:59.413273 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-12f64e87-6f78-464a-a69d-d683090e300d tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.160867 Sep 09 01:56:59.414307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 487/932] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:56:59 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:56:59.587186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:56:59.588045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:56:59.595657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:59.596750 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:59.597460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:59.598245 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:56:59.598783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:56:59.599269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:56:59.780597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:59.789314 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:59.790741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:56:59.791870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-59026f21-bc77-475d-930e-f7905016273c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1405 microversion: 2.20 time: 0.208671 Sep 09 01:56:59.792421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 446/933] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:56:59 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:57:00.245420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "name": "network-vif-plugged", "status": "completed", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:57:00.251304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:57:00.256493 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:00.256966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:00.257412 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:00.270010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] Creating event network-vif-plugged:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:57:00.274733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-c59a1ffd-a13d-45cf-ad50-521c9626212a req-eeefd8e5-8eed-4fef-bb7a-f9fb98f6dfe0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Sep 09 01:57:00.275310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 488/934] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:57:00.438144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:57:00.438711 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:57:00.442351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:57:00.446329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:00.446822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:00.447270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:00.447953 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:00.448412 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:00.448871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:00.641282 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:00.649014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8bf49a46-280d-4016-947f-170296cf6fee tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.214775 Sep 09 01:57:00.649596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 447/935] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:57:00 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:57:00.817959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:57:00.818854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:57:00.825270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:00.825759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:00.826196 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:00.826889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:00.827381 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:00.827804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:00.999721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:01.007728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:01.009192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:01.010323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b54f9cd3-bc40-4505-93a6-1adc982157d8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1597 microversion: 2.20 time: 0.197482 Sep 09 01:57:01.010870 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 489/936] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:57:00 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1597 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:57:01.034798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:57:01.035288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:57:01.041105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:01.041582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:01.042008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:01.042689 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:01.043135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:01.043550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:01.118614 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-15e9be95-5d78-47c5-8d91-f03697913932 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088086 Sep 09 01:57:01.119196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 448/937] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Sep 9 01:57:01 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:57:01.672409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:57:01.673014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:57:01.679863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:01.680338 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:01.680764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:01.681481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:01.681930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:01.682367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:01.896997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:01.904727 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-43ca1a1f-446b-4d9f-bb2b-3af128e082b4 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1577 microversion: 2.1 time: 0.236121 Sep 09 01:57:01.905318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 490/938] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:57:01 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:57:02.113325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:57:02.122901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:02.123379 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:02.123805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:02.134655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] Creating event network-changed:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 01:57:02.139799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-36befdad-949f-486b-a0a9-4550025c0d8e req-4286378e-da0b-490c-adb7-91988a065454 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030939 Sep 09 01:57:02.140852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 449/939] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:57:02.930018 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:57:02.930626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:57:02.938469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:02.938818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:02.939250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:02.940615 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:57:02.941150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:57:02.941571 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:57:03.165241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:57:03.173086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7762c538-f70d-414f-b2d2-efc3d5921df7 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1564 microversion: 2.1 time: 0.246829 Sep 09 01:57:03.173605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 491/940] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:57:02 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:15.616788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=4 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:15.617470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=66 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:15.622799 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:15.623383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:15.631100 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:15.631580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:15.632012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:15.632702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:15.633176 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:15.633602 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:15.655702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-934e87e9-62b7-4d89-8955-8733f56c17c4 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/ips" status: 200 len: 149 microversion: 2.1 time: 0.041324 Sep 09 01:58:15.656256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 450/941] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:58:15 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:21.208814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=7 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:21.209605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=29 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:21.215304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1b3dd3d-ccbf-4a58-a916-e56e0d099a51"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:21.218142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:21.224717 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:21.225222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:21.225650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:21.226325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:21.226800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:21.227214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:21.494588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9082976a-beed-408b-8d0d-b792b438ad25 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287446 Sep 09 01:58:21.495206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 492/942] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:58:21 2022] POST /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:21.520180 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-958184002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785472344", "security_groups": [{"name": "tempest-secgroup-smoke-1748851516"}], "block_device_mapping_v2": [{"uuid": "6779175c-e3e7-4668-bd08-a38287b3fa5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:21.639012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] validate_networks() for [('eeb9bceb-2be6-4f6a-a258-65bc6fe9a4ba', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:58:22.245471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:58:22.245897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:58:22.246400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:58:22.246803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:58:22.247208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:58:22.255883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:22.256348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:22.256778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:22.257530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:22.258013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:22.258434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:22.274838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:58:22.278779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Getting quotas for user fa5465b818f34778a1d51278653488ed and project 826001ffb29b4d42a5c299154c17b93e. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:58:22.334363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:58:22.336851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6779175c-e3e7-4668-bd08-a38287b3fa5e',volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:58:22.464972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8e5f47ca-9a4f-47c2-a88b-858bb520b16a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.948764 Sep 09 01:58:22.465574 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 451/943] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:58:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:58:22.478361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-014e63e4-8ddf-4884-81b1-b8e567d69267 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:22.479051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-014e63e4-8ddf-4884-81b1-b8e567d69267 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:22.535681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-014e63e4-8ddf-4884-81b1-b8e567d69267 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:22.542521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-014e63e4-8ddf-4884-81b1-b8e567d69267 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1093 microversion: 2.1 time: 0.068787 Sep 09 01:58:22.543090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 493/944] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:22 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:23.565016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:23.565650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:23.571615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:23.572126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:23.572554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:23.573269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:23.573722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:23.574151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:23.642942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:23.650572 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1793f7e9-3c17-423f-8025-1d43ae71efec tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1191 microversion: 2.1 time: 0.090684 Sep 09 01:58:23.651251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 452/945] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:23 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:24.674276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:24.674817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:24.681929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:24.682421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:24.682858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:24.683552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:24.684011 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:24.684433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:24.877552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:24.885144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1fe236aa-e9be-46f8-a20e-7bac52958830 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1277 microversion: 2.1 time: 0.214905 Sep 09 01:58:24.885713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 494/946] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:24 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1277 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:25.195336 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1", "tag": "ee570d29-fbda-4579-8583-80c17ac6a76d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:25.207487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:25.208055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:25.208705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:25.219655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] Creating event network-changed:ee570d29-fbda-4579-8583-80c17ac6a76d for instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 on hv-cinder-85221 Sep 09 01:58:25.224593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-502ae350-b19a-45ee-b42f-7d9e0c6ab777 req-58f1b079-65e4-468d-b93c-0585510333e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032772 Sep 09 01:58:25.225191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 453/947] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:25.909945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:25.910575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:25.917782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:25.917958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:25.918382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:25.919084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:25.919538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:25.920040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:26.142033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:26.150135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b0737fc6-2022-4a25-9f7d-30a5aff09d1c tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1277 microversion: 2.1 time: 0.244568 Sep 09 01:58:26.150847 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 495/948] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:25 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:27.173349 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:27.174059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:27.180532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:27.181017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:27.181485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:27.182172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:27.182625 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:27.183054 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:27.358348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:27.366504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cd822ca1-5992-4670-8d93-bc0567f8ba7f tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1277 microversion: 2.1 time: 0.197242 Sep 09 01:58:27.367202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 454/949] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:27 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:28.390500 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:28.391101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:28.397369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:28.397846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:28.398278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:28.398974 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:28.399420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:28.399934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:28.447444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:28.448974 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:28.456596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:28.457125 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:28.457642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:28.458330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:28.458787 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:28.459215 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:28.486158 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-98101667-e174-49e9-ae2f-bc24891920f6 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/ips" status: 200 len: 145 microversion: 2.1 time: 0.042837 Sep 09 01:58:28.486728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 455/950] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:58:28 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:58:28.601988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:28.610364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f1be5655-4a53-4580-81fd-1c43fadb8995 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1277 microversion: 2.1 time: 0.223742 Sep 09 01:58:28.611184 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 496/951] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:28 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:29.041237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1b3dd3d-ccbf-4a58-a916-e56e0d099a51"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:29.043579 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:29.049401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.049885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.050318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.051004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.051456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.051879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.130302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: POST /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments HTTP/1.1 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 74 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:58:29.132017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {"volumeAttachment": {"volumeId": "d1b3dd3d-ccbf-4a58-a916-e56e0d099a51"}} Sep 09 01:58:29.133736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'server_id': 'd7f74eb0-9fbe-4196-9a06-a6fd8975a76b', 'body': {'volumeAttachment': {'volumeId': 'd1b3dd3d-ccbf-4a58-a916-e56e0d099a51'}}} Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:29.134809 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:29.136234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 400 to user: Invalid volume: volume d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 is already attached to instances: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-99ed57fc-708b-488f-8f5d-6728e1c8c231 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096279 Sep 09 01:58:29.137882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 456/952] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:58:29 2022] POST /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 01:58:29.200377 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:29.200897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:29.206763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.207236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.207838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.208522 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.208965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.209407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.286787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'services' on Instance uuid d7f74eb0-9fbe-4196-9a06-a6fd8975a76b {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:29.358195 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-014281a6-a5be-45b6-baa2-c57e704c2e46 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments/d1b3dd3d-ccbf-4a58-a916-e56e0d099a51" status: 202 len: 0 microversion: 2.1 time: 0.161365 Sep 09 01:58:29.358772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 497/953] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:58:29 2022] DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments/d1b3dd3d-ccbf-4a58-a916-e56e0d099a51 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:58:29.367414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:29.369705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:29.377185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.377714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.378153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.378913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.379444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.379866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.409783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-51b69f22-7049-4346-922b-3911f06a4576 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Sep 09 01:58:29.410343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 457/954] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:29 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:29.634879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:29.635568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:29.642629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.643134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.643560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.644233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.644683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.645119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.774610 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:29.782672 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3e731341-981e-4e4b-a964-1bb560a96594 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1277 microversion: 2.1 time: 0.151973 Sep 09 01:58:29.783233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 498/955] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:29 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:29.838174 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42225ae4-748e-4e13-9824-9ae5401dd7e6"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:29.840592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:29.847111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.847597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.848030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:29.848749 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:29.849295 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:29.849724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:30.130122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-204220c5-3d2c-4a1b-9f3c-becc36580b03 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295669 Sep 09 01:58:30.130717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 458/956] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:58:29 2022] POST /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:30.422386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:30.424636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:30.430684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:30.431164 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:30.431596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:30.432280 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:30.432732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:30.433178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:30.464290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6a085d3e-7209-4bcd-a69a-2dfa2767c8f7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046373 Sep 09 01:58:30.465150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 499/957] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:30 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:30.806591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:30.807247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:30.813535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:30.814024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:30.814472 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:30.815158 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:30.815615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:30.816040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:30.946104 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:30.953711 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ba351c72-c8d7-4009-beae-ff18fc56d364 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.151872 Sep 09 01:58:30.954270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 459/958] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:30 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:31.476691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:31.478846 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:31.485807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:31.486285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:31.486711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:31.487380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:31.487827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:31.488253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:31.518626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4d819339-9b19-4270-8c8a-8e74648675d7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Sep 09 01:58:31.519218 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 500/959] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:31 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:31.977161 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:31.977770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:31.984246 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:31.984723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:31.985175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:31.985862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:31.986309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:31.986722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.119585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:32.127776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6465fe35-c775-4231-9f38-b82516a96496 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.154803 Sep 09 01:58:32.128335 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 460/960] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:31 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:32.531105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:32.533239 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:32.539515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.539992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.540426 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.541136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.541590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.542010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.542545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:32.572550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a651b6fa-c523-4f2e-8407-52286dc75118 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045391 Sep 09 01:58:32.573120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 501/961] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:32 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 01:58:32.635016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:32.635508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:32.637444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:32.638213 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:32.645462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.645907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.646374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.647075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.647535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.647969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.673494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:58:32.748012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-65902223-a45a-43d4-9110-2d0fe8b59752 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 204 len: 0 microversion: 2.1 time: 0.116541 Sep 09 01:58:32.749033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 461/962] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:58:32 2022] DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:58:32.757035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:32.757811 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:32.763755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.764232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.764684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.765558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:32.765824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:32.766241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:32.896734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:32.903723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c0349dd3-4db3-4b39-a9d9-fc6f6a3adaad tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1681 microversion: 2.1 time: 0.150513 Sep 09 01:58:32.904380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 502/963] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:32 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:33.151218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:33.151923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:33.157830 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:33.158312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:33.158744 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:33.159431 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:33.159888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:33.160311 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:33.293022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:33.301206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7b3def0b-f875-4d37-a056-9365663fe25e tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.154232 Sep 09 01:58:33.301943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 462/964] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:33 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:33.926969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:33.927580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:33.933924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:33.934408 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:33.934840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:33.936168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:33.936621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:33.937041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:34.066067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:34.073621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-302d315d-ac25-4af1-b18a-3b071cc848cc tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1681 microversion: 2.1 time: 0.150565 Sep 09 01:58:34.074202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 503/965] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:33 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:34.323682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:34.324294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:34.331198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:34.331676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:34.332106 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:34.332783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:34.333260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:34.333676 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:34.466255 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:34.473943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a5014f46-1b72-458b-a763-573927b66e51 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.154063 Sep 09 01:58:34.474491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 463/966] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:34 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:35.097648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:35.098258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:35.104694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:35.105209 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:35.105634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:35.106322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:35.106773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:35.107232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:35.317190 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:35.324757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dec20e7a-93f7-4bcb-8bf1-7b7baadcb5cf tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1681 microversion: 2.1 time: 0.231045 Sep 09 01:58:35.325355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 504/967] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:35 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:35.497148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:35.498381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:35.504899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:35.505420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:35.505855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:35.506542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:35.507000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:35.507421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:35.722308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:35.730027 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-472d54fd-aa66-4cb8-8f1f-2b0573140859 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.236760 Sep 09 01:58:35.730598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 464/968] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:35 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:35.941371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f74eb0-9fbe-4196-9a06-a6fd8975a76b", "name": "network-vif-deleted", "tag": "e989a7b5-3021-4074-b660-80d53ef9d5a6"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:35.952553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:35.953033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:35.953725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:35.970994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] Creating event network-vif-deleted:e989a7b5-3021-4074-b660-80d53ef9d5a6 for instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b on hv-cinder-85221 Sep 09 01:58:35.976017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-481a5e5e-6b06-4add-88ce-efc72531df26 req-8848f361-5c46-4a13-8d3c-c48779565644 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038513 Sep 09 01:58:35.976702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 505/969] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:36.348781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:36.349674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:36.355644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:36.356126 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:36.356554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:36.357886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:36.358353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:36.358774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:36.389285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:36.407877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:36.408444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:36.408875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:36.409353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'fault' on Instance uuid d7f74eb0-9fbe-4196-9a06-a6fd8975a76b {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:36.451285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:36.458987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7ce5d2b2-d8cc-4055-aac1-8ceb50371c6a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 200 len: 1332 microversion: 2.1 time: 0.114067 Sep 09 01:58:36.459559 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 465/970] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:36 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:36.756901 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:36.757592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:36.764739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:36.765254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:36.765689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:36.766389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:36.766842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:36.767261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:36.907339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:36.915683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aa226a7c-2b8f-4d7a-ad9a-20db38005cad tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.163914 Sep 09 01:58:36.929325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 506/971] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:36 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:37.483198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:37.483813 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:37.490235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:37.490717 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:37.491418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:37.492104 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:37.492561 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:37.492984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:37.506861 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b HTTP/1.1 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:58:37.508424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 01:58:37.510017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'd7f74eb0-9fbe-4196-9a06-a6fd8975a76b'} Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:58:37.510848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 01:58:37.512310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:58:37.513737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:58:37.513737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0db980a1-547f-48d5-a2b6-bd5f42e0af3a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 404 len: 111 microversion: 2.1 time: 0.031019 Sep 09 01:58:37.513737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 466/972] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:37 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:58:37.518639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a8da8181-ee17-460f-8114-7945fe1cd97f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '.version_select at 0x7f87dbe3c790>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:37.536553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a8da8181-ee17-460f-8114-7945fe1cd97f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913107466" status: 202 len: 0 microversion: 2.1 time: 0.021729 Sep 09 01:58:37.537150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 507/973] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Sep 9 01:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913107466 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:58:37.939361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:37.939975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:37.946042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:37.946530 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:37.946970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:37.947666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:37.948122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:37.948548 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:38.083499 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:38.091255 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3947cf89-3a5a-486b-8ec9-e96719d75878 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.156225 Sep 09 01:58:38.091821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 467/974] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:37 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:38.158441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-56fb4065-9dc1-47f6-a668-4a06d1ceb6a1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: .version_select at 0x7f87dbe55040>, body: {"keypair": {"name": "tempest-keypair-1317751646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqLWfHNw4OHANFv+AmribpUO+++IXV5Ty5WhFrrrCqOFVkVeWOL+0Q9+tK1m2UTOAQ+fYkY94J46pEB/pev7vJ29Zj/MmfCXje6EhcMULVL4IcmC3sqNb/9wlBZXMD4DA=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:38.174025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-56fb4065-9dc1-47f6-a668-4a06d1ceb6a1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:58:38.177797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-56fb4065-9dc1-47f6-a668-4a06d1ceb6a1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:58:38.198461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-56fb4065-9dc1-47f6-a668-4a06d1ceb6a1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044942 Sep 09 01:58:38.199038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 508/975] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 01:58:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:39.114294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:39.114885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:39.121725 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:39.122211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:39.123316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:39.124273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:39.124736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:39.125222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:39.335291 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:39.343749 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f24009ab-ad75-46fa-9ffb-f2a1a0cdcc14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.233408 Sep 09 01:58:39.344756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 468/976] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:39 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:39.902433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2145098476", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3840bd6e-907e-4191-be2d-5f3b8f05d0c8"}], "security_groups": [{"name": "tempest-securitygroup--19377768"}], "key_name": "tempest-keypair-1317751646", "user_data": "}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:40.004334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.network.neutron [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] validate_networks() for [('3840bd6e-907e-4191-be2d-5f3b8f05d0c8', None, None, None, None, None)] {{(pid=126895) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 01:58:40.367901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:40.368862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:40.375818 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.376302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.376759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.377477 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.377945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.378348 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.551301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 01:58:40.551781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image limits 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 01:58:40.552276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Flavor pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 01:58:40.552844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Image pref 0:0:0 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 01:58:40.553725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.virt.hardware [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 01:58:40.563907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.564394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.564816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.565591 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.566374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.566877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.584725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 01:58:40.588639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Getting quotas for user 04b569b91d1045dc8257c8aaa868842a and project 37932fe56b864be6b57f92a76e92cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 01:58:40.596585 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:40.604865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-98061f15-574a-4d5d-8b8c-f1c1211bf885 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.240879 Sep 09 01:58:40.606637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 469/977] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:40 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:40.607275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Going to run 1 instances... {{(pid=126895) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 01:58:40.609841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 01:58:40.666286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-20064014-ee5f-49f6-ab9d-48bf11f8205e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.768579 Sep 09 01:58:40.666937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 509/978] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 01:58:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 01:58:40.678576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2227fb3b-9c3d-436a-8728-0cefe79888ea tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:40.679628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2227fb3b-9c3d-436a-8728-0cefe79888ea tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:40.789505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2227fb3b-9c3d-436a-8728-0cefe79888ea tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:40.800786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2227fb3b-9c3d-436a-8728-0cefe79888ea tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1242 microversion: 2.1 time: 0.125272 Sep 09 01:58:40.801998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 470/979] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:40 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:40.871222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:40.874289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:40.882228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.882819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.883296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.884067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.884566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.884976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.916946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:40.928866 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ad3b288f-1c9d-4649-bd53-f2010ab9daa8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062208 Sep 09 01:58:40.929573 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 510/980] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:40 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:40.941197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:40.941698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:40.958430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.959050 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.959576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.960424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:40.961217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:40.961737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:40.998725 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a9766e11-fd52-45d2-98f9-0ea3bbca8aa4 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6" status: 200 len: 194 microversion: 2.1 time: 0.061456 Sep 09 01:58:40.999325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 471/981] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 01:58:40 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:41.117251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1", "name": "network-vif-plugged", "status": "completed", "tag": "ee570d29-fbda-4579-8583-80c17ac6a76d"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:41.129785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:41.130262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:41.130806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:41.144691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] Creating event network-vif-plugged:ee570d29-fbda-4579-8583-80c17ac6a76d for instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 on hv-cinder-85221 Sep 09 01:58:41.150192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-3507b4a4-babe-49f6-b0ad-031aaf83b94c req-2e6837eb-085e-489d-a834-6eb36acb222b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041451 Sep 09 01:58:41.151351 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 511/982] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:41.627631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:41.628270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:41.634591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:41.635076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:41.635509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:41.636203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:41.636656 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:41.637103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:41.824123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:41.824894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:41.832851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:41.833584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:41.834074 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:41.834549 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:41.834927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:41.835380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:41.835820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:41.843310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cbd821da-3c88-4ca1-a87e-ce0ff18d1d82 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.219451 Sep 09 01:58:41.844238 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 472/983] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:41 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:41.902950 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:41.911315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-31ce0a2b-26f4-45c4-b079-c4db3be27e6c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1238 microversion: 2.1 time: 0.091291 Sep 09 01:58:41.911945 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 512/984] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:41 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:42.351263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d74fc181-770d-4b87-8271-397df89de258"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:42.353702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:42.359580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.360057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.360485 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:42.361193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.361644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.362065 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:42.714876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2d971be9-c779-4eff-8905-ce09e1b2f93d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "POST /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367434 Sep 09 01:58:42.715582 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 473/985] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 01:58:42 2022] POST /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:42.867334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:42.868056 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:42.874445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.875123 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.875860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:42.876780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.877270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.877693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:42.938687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:42.939524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:42.945815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.946393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.946896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:42.947688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:42.948318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:42.948745 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.077738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:43.085301 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ec14e077-2789-48bf-96aa-4be0908bb7b7 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1238 microversion: 2.1 time: 0.151859 Sep 09 01:58:43.085783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 474/986] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:42 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:43.129640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:43.137275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2460b1b9-c922-4239-ada1-e257acdf15f2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1265 microversion: 2.1 time: 0.274276 Sep 09 01:58:43.137849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 513/987] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:42 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:43.672908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:43.673510 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:43.678294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:43.685409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:43.685893 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:43.686320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.687020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:43.689026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:43.689737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:43.690250 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.697198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:43.697642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.723066 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] Creating event network-changed:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:58:43.730964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-49870229-6cf9-42f4-9601-00312f2d7f51 req-79634acb-ddb9-4043-82b1-b2a2c1445cab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056294 Sep 09 01:58:43.731902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 514/988] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:58:43.739375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:58:43.831087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3ff2d0fa-6821-4769-b9a5-82a594b2c393 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 204 len: 0 microversion: 2.1 time: 0.163977 Sep 09 01:58:43.831979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 475/989] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:58:43 2022] DELETE /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:58:43.843558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:43.844253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:43.850305 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:43.851398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:43.851837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.852529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:43.852981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:43.853423 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:43.996894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:44.004712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fdabd269-e993-4903-b3bc-cbfc25d0baea tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.165885 Sep 09 01:58:44.005390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 515/990] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:43 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:44.108177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:44.108987 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:44.114985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.115541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.116295 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.117087 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.117619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.118108 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.160992 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:44.173511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:44.187670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.188503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.188974 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:44.189429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.190154 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.190763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.191338 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.199614 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6202bebb-6579-4465-a64f-5bf34f9696eb tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1294 microversion: 2.1 time: 0.095705 Sep 09 01:58:44.201023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 476/991] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:44 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:44.336041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:44.344645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-75223a4e-15ce-4309-84c6-b49308d61647 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1452 microversion: 2.1 time: 0.187756 Sep 09 01:58:44.345281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 516/992] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:44 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:44.367111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:44.368028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:44.374229 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.374673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.375131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.375772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.376220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.376660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.427580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:44.427955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:44.435192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.435975 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.436411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.437145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:44.437604 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:44.438028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:44.463801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-840396a9-0b74-490f-bb58-2564b75f673f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/ips" status: 200 len: 151 microversion: 2.20 time: 0.040205 Sep 09 01:58:44.464506 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 517/993] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Sep 9 01:58:44 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 01:58:44.512704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:44.520916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ee828acb-c21b-4033-b981-342f905d0b34 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1452 microversion: 2.1 time: 0.157953 Sep 09 01:58:44.521601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 477/994] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:44 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:45.027740 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:45.028354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:45.034691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:45.035176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:45.035616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:45.036306 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:45.036764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:45.037217 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:45.171069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:45.178933 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2c319bd2-738c-4b0e-be5c-e94b22b6b7dc tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.155077 Sep 09 01:58:45.179504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 518/995] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:45 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:45.223233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:45.223774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:45.230170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:45.230682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:45.231118 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:45.231807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:45.232258 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:45.232677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:45.295052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:45.302597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c23180ba-6215-4b67-b2b3-d7731a13b432 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1294 microversion: 2.1 time: 0.083419 Sep 09 01:58:45.303377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 478/996] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:45 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:46.203851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:46.204545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:46.210840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.211321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.211747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.212428 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.212873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.213312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.284797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1", "tag": "ee570d29-fbda-4579-8583-80c17ac6a76d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:46.290220 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:46.301203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.301663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.302198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.323171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] Creating event network-changed:ee570d29-fbda-4579-8583-80c17ac6a76d for instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 on hv-cinder-85221 Sep 09 01:58:46.328631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-4557dba9-4ef0-4ee0-8711-ec7d652fa8ca req-1178c32d-28a9-4c00-ad10-500cb7b3df96 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047438 Sep 09 01:58:46.329272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 479/997] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:58:46.337663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:46.338375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:46.344685 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.345423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.346017 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.346904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.347517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.348099 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.427029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:46.435943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b3289f0a-933c-483c-8104-ddc9e056df3f tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.236417 Sep 09 01:58:46.436865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 519/998] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:46 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:46.462072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:46.466103 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:46.467447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:46.471283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-efe6b72d-088d-40da-97c3-cb350c98b312 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1294 microversion: 2.1 time: 0.140515 Sep 09 01:58:46.471868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 480/999] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:46 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1294 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:46.486089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.486788 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.487327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.488127 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.488596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.488991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.512570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lazy-loading 'flavor' on Instance uuid 86c66864-02f8-472d-9eaa-493d8b436cea {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:46.723852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-163b6337-b1a2-40d7-8721-1e99ce3489c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/action" status: 202 len: 0 microversion: 2.20 time: 0.263187 Sep 09 01:58:46.736776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:46.737455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:46.746891 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 520/1000] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 01:58:46 2022] POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 01:58:46.748754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.749243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.749766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.750478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:46.750955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:46.752515 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:46.773647 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:47.435807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:47.444982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:47.446554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:47.447808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-259d5fe7-44dd-441c-bf6d-d4b9f1bfc5d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.717162 Sep 09 01:58:47.449242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 481/1001] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:46 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:47.471446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:47.473022 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:47.483266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:47.483842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:47.484350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:47.485155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:47.485839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:47.486386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:47.495837 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:47.496540 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:47.515028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:47.515555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:47.517201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:47.519442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:47.520170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:47.520774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:47.679963 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:47.689042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8314dcac-e04e-4cdd-917e-5ce98823f46a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1300 microversion: 2.1 time: 0.196922 Sep 09 01:58:47.690274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 482/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:47 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:47.853932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:47.874225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a60d8448-65c7-4781-9d47-6542c72fd088 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1570 microversion: 2.1 time: 0.407105 Sep 09 01:58:47.877970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 521/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:47 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1570 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:48.346069 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e8adc-fc93-442f-8cd0-800c05ecc65b", "name": "network-vif-deleted", "tag": "810b3be9-fa06-4cac-bf3e-35158ddfaaab"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:48.361120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.361867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.362687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.376202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] Creating event network-vif-deleted:810b3be9-fa06-4cac-bf3e-35158ddfaaab for instance f70e8adc-fc93-442f-8cd0-800c05ecc65b on hv-cinder-85221 Sep 09 01:58:48.393172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-c65800ec-076a-4435-a395-6b6af30b569f req-a69942da-afd7-48d8-808a-4406803f99f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052021 Sep 09 01:58:48.394209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 483/1004] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:48.475873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:48.476512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:48.482792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.483316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.484059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.484932 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.485417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.486000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.668230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:48.677038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:48.678841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:48.680030 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-82ee86a3-3ab4-4213-9d14-3c5d07eb077b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.208201 Sep 09 01:58:48.680578 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 522/1005] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:48 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:48.714112 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:48.714871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:48.721659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.722137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.722564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.723247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.723702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.724115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.904741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:48.905381 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:48.911242 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.911816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.912251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.912936 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.913420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.913842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.953512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:48.954267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:48.954720 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:48.955162 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lazy-loading 'fault' on Instance uuid f70e8adc-fc93-442f-8cd0-800c05ecc65b {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:48.990824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:48.999394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5d36de5c-de8f-4e31-99b3-0c673f2a2b75 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.289416 Sep 09 01:58:48.999974 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 484/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:48 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:49.020481 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9efeb413ec245cfb83821f6b3433bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550fb18df8234f6cb7d5fdf9770ce11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:49.028146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e02e4a58-298a-41fe-a493-b41666178199 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 200 len: 1224 microversion: 2.1 time: 0.127905 Sep 09 01:58:49.028716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 523/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:48 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 1224 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:49.437191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb71f445-63cd-4f1e-8a16-2e6921989dae", "tag": "9a6d5ee2-7a02-445f-b3ae-9eab82538476"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:49.447158 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:49.447637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:49.448065 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:49.460445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] Creating event network-changed:9a6d5ee2-7a02-445f-b3ae-9eab82538476 for instance cb71f445-63cd-4f1e-8a16-2e6921989dae on hv-cinder-85221 Sep 09 01:58:49.465331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-f181d4af-f92f-432c-bc26-7b26bd576d8b req-bbde7d6d-49a4-488d-a26e-7d528851a554 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032548 Sep 09 01:58:49.466601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 485/1008] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:49.706028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:49.706633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:49.713464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:49.713982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:49.714403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:49.715088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:49.715535 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:49.716462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:49.922093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:49.930128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:49.931657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:49.932915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-380db352-322d-4814-b229-34441cb567ba tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.230822 Sep 09 01:58:49.933507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 524/1009] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:49 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:50.023257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:50.023997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:50.030329 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.030812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.031253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:50.031938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.032386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.032802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:50.051480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:50.052308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] [instance: f70e8adc-fc93-442f-8cd0-800c05ecc65b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:50.055430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:50.060166 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.060661 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.061116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:50.061818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.062292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.062716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:50.078073 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] HTTP exception thrown: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Request method failure captured: Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b HTTP/1.1 Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpxcGabhoIs-Gkxusqyjh1ZRYNUzck7M7AXYMKvNQSgRGTyvaPzBybNFP3wKUVJ9vCWpTSmax9NB1OqGDitVrpCLlFVicOP0G30e0x5N9u5FIqT1L5IY-ccTDeip3Bg4O2wDvRi1FzockioX-A7tvYmq59aa14wAxnN7s6cQUX4_xiA Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 550fb18df8234f6cb7d5fdf9770ce11e Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestShelveInstance-313933378 Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:58:50.079741 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/550fb18df8234f6cb7d5fdf9770ce11e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/550fb18df8234f6cb7d5fdf9770ce11e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/550fb18df8234f6cb7d5fdf9770ce11e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_550fb18df8234f6cb7d5fdf9770ce11e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestShelveInstance-313933378 Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 550fb18df8234f6cb7d5fdf9770ce11e Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestShelveInstance-313933378 Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestShelveInstance-313933378-project Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: c9efeb413ec245cfb83821f6b3433bbe Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestShelveInstance-313933378-project Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. Sep 09 01:58:50.081342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'f70e8adc-fc93-442f-8cd0-800c05ecc65b'} Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:58:50.082203 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. Sep 09 01:58:50.083480 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:58:50.084686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Returning 404 to user: Instance f70e8adc-fc93-442f-8cd0-800c05ecc65b could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:58:50.084686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-19c0c77e-c325-40c9-af0f-6f3e2ea91ead tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b" status: 404 len: 111 microversion: 2.1 time: 0.033435 Sep 09 01:58:50.084686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 525/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:50 2022] GET /compute/v2.1/servers/f70e8adc-fc93-442f-8cd0-800c05ecc65b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 01:58:50.170275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:50.177821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-37a17fd4-c638-49d6-9cb3-a9de9bfc58af tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.158773 Sep 09 01:58:50.178389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 486/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:50 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:50.246084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f125c4df-81a2-4ac5-8077-d360d3f10a44 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] Calling method '.version_select at 0x7f87dbe880d0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:50.273930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f125c4df-81a2-4ac5-8077-d360d3f10a44 tempest-TestShelveInstance-313933378 tempest-TestShelveInstance-313933378-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1621572188" status: 202 len: 0 microversion: 2.1 time: 0.031951 Sep 09 01:58:50.275121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 526/1012] 10.222.0.15 () {58 vars in 1254 bytes} [Fri Sep 9 01:58:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1621572188 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:58:50.961609 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:50.962225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:50.964668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:50.969882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.970390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.970833 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:50.971547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:50.972011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:50.973666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:51.117037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:51.125088 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:51.126527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:51.127677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-eff1b723-1538-4aca-829c-00e30187fd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.173552 Sep 09 01:58:51.128240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 487/1013] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:50 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:51.197865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=2 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:51.198633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=10 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:51.203963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:51.204788 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:51.213526 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:51.214282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:51.214877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:51.216282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:51.216903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:51.217360 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:51.375724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:51.392290 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-804a6ad4-2c0b-4be9-9d72-83ba82851eba tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.195094 Sep 09 01:58:51.392862 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 527/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:51 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:52.163253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:52.163864 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:52.171645 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:52.172401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:52.173137 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:52.174196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:52.174933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:52.175505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:52.310446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:52.319219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:52.320617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:52.322364 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-fe681e97-938c-48c3-9723-410a529e36be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.168794 Sep 09 01:58:52.323195 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 488/1015] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:52 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:52.415559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:52.416199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:52.423697 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:52.424198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:52.424637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:52.425368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:52.425826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:52.426252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:52.450754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:52.578215 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:52.588245 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-54319f37-8e4c-4989-8afd-e8e3a10e7b71 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.176944 Sep 09 01:58:52.589244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 528/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:52 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:53.348352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:53.350000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:53.358780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:53.359539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:53.360320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:53.360690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:53.361311 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:53.361746 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:53.612320 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:53.612928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:53.620016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:53.620508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:53.620943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:53.622211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:53.622885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:53.625592 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:53.982093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:53.991584 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:53.993619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:53.995004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4da4235f-c3ed-468d-b256-3692d485d9f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.650982 Sep 09 01:58:53.995658 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 489/1017] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:53 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:54.126455 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:54.134814 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-004ed761-b014-4188-a0c0-7f6be51aff8f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.526388 Sep 09 01:58:54.135470 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 529/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:53 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:54.642192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:54.644322 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:54.651044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.651529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.651959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.652687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.653435 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.654214 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.688437 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e5f04ee5-c305-4b8c-85c3-70764a89e99c tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049942 Sep 09 01:58:54.688892 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 490/1019] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:54 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:54.785574 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:54.786125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:54.792286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.792764 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.793223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.794407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.794852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.795264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.825994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e229f95c-c03a-471c-b27f-99730d29a76e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6" status: 200 len: 194 microversion: 2.1 time: 0.044449 Sep 09 01:58:54.826599 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 530/1020] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 01:58:54 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:54.837315 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:54.837930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:54.844476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.844966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.845436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.846130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:54.846583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:54.847004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:54.941009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lazy-loading 'services' on Instance uuid 875530d8-7896-4c8d-ad2b-ec715b49421d {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:55.025279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:55.025555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-274201d1-d87d-444a-b879-177462be511d tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6" status: 202 len: 0 microversion: 2.1 time: 0.191751 Sep 09 01:58:55.025972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:55.026841 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 491/1021] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:58:54 2022] DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/42225ae4-748e-4e13-9824-9ae5401dd7e6 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:58:55.039335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:55.042098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:55.042851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:55.044549 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:55.045205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:55.047430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:55.159728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:55.160793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:55.168102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:55.169390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:55.170307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:55.171089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:55.171616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:55.172279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:55.285813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:55.301924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:55.304011 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:55.305834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8adbff93-62f4-425c-a91a-6cb8130d6056 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.285605 Sep 09 01:58:55.307552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 531/1022] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:55 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:58:55.313608 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71f445-63cd-4f1e-8a16-2e6921989dae", "name": "network-vif-plugged", "status": "completed", "tag": "9a6d5ee2-7a02-445f-b3ae-9eab82538476"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:58:55.328113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:55.330352 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:55.331120 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:55.351262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:55.352156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] Creating event network-vif-plugged:9a6d5ee2-7a02-445f-b3ae-9eab82538476 for instance cb71f445-63cd-4f1e-8a16-2e6921989dae on hv-cinder-85221 Sep 09 01:58:55.357840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-c6835a12-b304-473d-ba2c-035eeed6f4a5 req-583318b2-b72a-4f1e-b8d7-5c4de882942f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048792 Sep 09 01:58:55.358810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 532/1023] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:55.362091 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b5c4919a-b22e-4751-9cfb-42f4e4781c3b tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.206704 Sep 09 01:58:55.362662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 492/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:55 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:58:56.336855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:56.337589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:56.343668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:56.344155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:56.344594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:56.345317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:56.345778 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:56.346201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:56.387817 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:56.388521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:56.395198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:56.395798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:56.396306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:56.397162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:56.397686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:56.398181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:56.536525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:56.548134 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:56.550960 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:56.553018 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b9ad1265-c41e-4ce8-b0cc-a636d82ba46a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.220648 Sep 09 01:58:56.554202 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 533/1025] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:56 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:56.604865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:56.616463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-15081f7f-caa5-474d-b213-37e5b47d6348 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.232432 Sep 09 01:58:56.621145 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 493/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:56 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:57.277641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:57.278163 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:57.284072 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.284557 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.284982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.285693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.286192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.286543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.316701 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7c422885-c23b-468c-8a3a-363686fcf6bd tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/d74fc181-770d-4b87-8271-397df89de258" status: 200 len: 194 microversion: 2.1 time: 0.043173 Sep 09 01:58:57.317321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 534/1027] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Sep 9 01:58:57 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/d74fc181-770d-4b87-8271-397df89de258 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:57.328571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:57.329085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:57.335026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.335508 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.336128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.336824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.337302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.337727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.441796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lazy-loading 'services' on Instance uuid 875530d8-7896-4c8d-ad2b-ec715b49421d {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 01:58:57.531337 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ef5da0df-353c-4dbe-b140-73a711c954df tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/d74fc181-770d-4b87-8271-397df89de258" status: 202 len: 0 microversion: 2.1 time: 0.207078 Sep 09 01:58:57.532649 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 494/1028] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 01:58:57 2022] DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments/d74fc181-770d-4b87-8271-397df89de258 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:58:57.582609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:57.585034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:57.593024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.593584 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.594049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.594773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.595229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.595650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.641267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:57.642031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:57.649195 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.650358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.650878 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.651845 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:57.652362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:57.652957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:57.777563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:57.788734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:57.790488 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:57.791748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e1639330-f385-4789-b855-c6753d369737 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.214212 Sep 09 01:58:57.792415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 535/1029] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:57 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:58:57.824075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:57.835596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ad33ee49-ed64-4a67-afc4-c57ffb861b95 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1366 microversion: 2.1 time: 0.198150 Sep 09 01:58:57.835596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 495/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:57 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:58.818300 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:58.819105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:58.826268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:58.826756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:58.827189 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:58.827887 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:58.828340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:58.828761 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:58.857651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:58.858210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:58.864597 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:58.865102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:58.865821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:58.866517 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:58.872581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:58.873038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.011691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:59.021168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:59.022879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:59.024043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-03c05c61-eaa1-4469-95b9-ade72436774e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.209871 Sep 09 01:58:59.024907 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 536/1031] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:58:58 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:58:59.042342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:58:59.050850 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e2b1cad4-f8e7-40f9-8a19-0cb8dc40733a tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1555 microversion: 2.1 time: 0.197042 Sep 09 01:58:59.051423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 496/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:58:58 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:58:59.072680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:59.073244 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:59.079637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.080118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.080551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.081266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.081725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.082143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.168402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8a62813e-9139-44d6-90a3-038eef0f0c4f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099493 Sep 09 01:58:59.168989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 537/1033] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Sep 9 01:58:59 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:58:59.771127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:59.773321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:59.780057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.780539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.780974 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.781692 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.782170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.782555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.810780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:58:59.817337 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-67c12226-94f7-499f-af1c-0101c9935507 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050081 Sep 09 01:58:59.818128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 497/1034] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:59 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 01:58:59.936269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:58:59.938997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:58:59.944925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.945444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.945884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.946575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:58:59.947030 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:58:59.947448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:58:59.979321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e6c06cd5-fbde-4311-8bbb-c539da8ba8d0 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047485 Sep 09 01:58:59.979976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 538/1035] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 01:58:59 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 01:59:00.043682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:00.044207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:00.050107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:00.050857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:00.050990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.051342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.051941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.052820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.053446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.054022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.057093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.057629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.058069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.058772 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.059551 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.059978 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.082277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 01:59:00.175869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-40be8d19-881e-49ed-abd9-799e5a08ef9e tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 204 len: 0 microversion: 2.1 time: 0.136073 Sep 09 01:59:00.176474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 498/1036] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:59:00 2022] DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:59:00.184351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb71f445-63cd-4f1e-8a16-2e6921989dae", "tag": "9a6d5ee2-7a02-445f-b3ae-9eab82538476"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:00.193618 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.194356 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.194950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.206674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] Creating event network-changed:9a6d5ee2-7a02-445f-b3ae-9eab82538476 for instance cb71f445-63cd-4f1e-8a16-2e6921989dae on hv-cinder-85221 Sep 09 01:59:00.211693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-5df143f6-1525-4e35-be1e-63dc0cf6e5eb req-e7e172b9-75b9-48aa-8095-b52050d58838 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033398 Sep 09 01:59:00.212486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 499/1037] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 01:59:00.218368 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:00.219058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:00.225148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.225628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.226055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.226743 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:00.227191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:00.227699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:00.231464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:00.240072 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:00.241854 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:00.243026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5713fe21-17e8-4492-8e86-05962d204c88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.196958 Sep 09 01:59:00.243792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 539/1038] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:00 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:00.359222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:00.367239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-57cc6228-746f-4983-8979-ab92d35a1a95 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1672 microversion: 2.1 time: 0.153453 Sep 09 01:59:00.367986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 500/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:00 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 01:59:01.268704 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:01.269331 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:01.275791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:01.276261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:01.276685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:01.277391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:01.278350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:01.278767 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:01.391344 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:01.391890 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:01.398202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:01.398684 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:01.399112 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:01.399796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:01.400573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:01.400699 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:01.410863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:01.419268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:01.420783 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:01.422048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-98586a3f-dfe7-46ec-a78f-a8683f2d3dce tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.157197 Sep 09 01:59:01.422709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 540/1040] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:01 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:01.541960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:01.549594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b355e033-8448-4d24-b898-3e781de19dda tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1672 microversion: 2.1 time: 0.162692 Sep 09 01:59:01.550155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 501/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:01 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:59:02.446923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:02.447528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:02.454486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:02.454985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:02.455412 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:02.456097 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:02.456545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:02.456959 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:02.572905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:02.573660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:02.580063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:02.580661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:02.581210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:02.581972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:02.582441 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:02.582865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:02.597214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:02.606445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:02.607893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:02.609051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f4c68ba4-7c36-4bef-a6cf-8d9bb791f830 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.166064 Sep 09 01:59:02.609839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 541/1042] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:02 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:02.717666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:02.725534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c782243b-9a9c-4b11-b590-95a678055647 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1672 microversion: 2.1 time: 0.156465 Sep 09 01:59:02.726327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 502/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:02 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:59:03.634668 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:03.635206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:03.641666 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:03.642191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:03.642657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:03.643337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:03.643793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:03.644214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:03.750102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:03.750715 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:03.757272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:03.757768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:03.758204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:03.758907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:03.759369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:03.759877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:03.840904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f9dc8c41604f0e86eaf57202285cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed13a0f61d34a80898093dc1d8e6610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:03.848579 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-09789c93-9681-4679-9e72-347db575e5c5 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 200 len: 1605 microversion: 2.1 time: 0.102955 Sep 09 01:59:03.849506 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 503/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:03 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 1605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 01:59:03.922712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:03.931385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875530d8-7896-4c8d-ad2b-ec715b49421d", "name": "network-vif-deleted", "tag": "fe022ad1-e9fa-447d-a522-14b9d96efbbe"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:03.931600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:03.933499 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:03.935712 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ef4f83cb-c8a3-43d4-96a6-3ef1e05382b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.305009 Sep 09 01:59:03.936291 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 542/1045] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:03 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:03.955001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:03.955982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:03.956628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:03.970119 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] Creating event network-vif-deleted:fe022ad1-e9fa-447d-a522-14b9d96efbbe for instance 875530d8-7896-4c8d-ad2b-ec715b49421d on hv-cinder-85221 Sep 09 01:59:03.976909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-ac3d3575-2323-4ae3-ac0f-61b4eb966ce7 req-9406cc86-8df6-47e3-96cb-b34b7aebbaca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049040 Sep 09 01:59:03.978281 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 504/1046] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:59:04.872495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:04.873301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:04.879991 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:04.880483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:04.880942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:04.881671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:04.882129 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:04.882550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:04.896575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d HTTP/1.1 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:04.898463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:04.899765 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '875530d8-7896-4c8d-ad2b-ec715b49421d'} Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:04.900731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:04.902861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:04.904395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:04.904395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-01957627-e662-4d25-a009-b6faeaea09f8 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 404 len: 111 microversion: 2.1 time: 0.031235 Sep 09 01:59:04.904395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 543/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:04 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:04.909993 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5e1f7e52-7f3e-4825-9754-2d424838f2c7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '.version_select at 0x7f87d8650a60>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:04.914347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e1f7e52-7f3e-4825-9754-2d424838f2c7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [2789f481-e9bf-4c7a-a714-eff8a3b3d19c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 01:59:04.967347 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:04.968099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:04.973982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:04.974462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:04.974889 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:04.975562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:04.976006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:04.976418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:05.113118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:05.123051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:05.124510 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:05.125726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-80e280b8-45f4-41f9-812b-0db70c6c9104 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1742 microversion: 2.20 time: 0.162773 Sep 09 01:59:05.126282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 544/1048] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:04 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:05.922680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e1f7e52-7f3e-4825-9754-2d424838f2c7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [2789f481-e9bf-4c7a-a714-eff8a3b3d19c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 42370. Sep 09 01:59:05.940420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5e1f7e52-7f3e-4825-9754-2d424838f2c7 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672822623" status: 202 len: 0 microversion: 2.1 time: 1.035057 Sep 09 01:59:05.941000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 505/1049] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Sep 9 01:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672822623 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 01:59:06.150079 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:06.150590 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:06.157624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:06.158107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:06.158539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:06.159251 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:06.159700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:06.160121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:06.295071 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:06.303175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:06.304635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:06.305822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-48fad464-7f17-4d06-b035-22abec10383f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1742 microversion: 2.20 time: 0.159722 Sep 09 01:59:06.306378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 545/1050] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:06 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:07.177305 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "name": "network-vif-plugged", "status": "completed", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:07.187941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:07.188592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:07.189026 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:07.200159 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] Creating event network-vif-plugged:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 01:59:07.205171 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-33a4e465-400c-4c8d-806b-79460d4e52ce req-ca1523f3-a614-432c-b557-93ae579ce043 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Sep 09 01:59:07.205820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 506/1051] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 01:59:07.331049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:07.331657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:07.338154 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:07.338635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:07.339069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:07.339752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:07.340248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:07.340667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:07.470647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:07.474178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=100 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:07.479560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:07.480993 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:07.482176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f95d2214-f383-4620-bfac-371b0fe0e4b2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1742 microversion: 2.20 time: 0.154999 Sep 09 01:59:07.482736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 546/1052] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:07 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:08.508910 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:08.509553 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:08.515767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.516256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.516689 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.517414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.517870 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.518292 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.647478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:08.656122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:08.657590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:08.658770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a0271e02-82a1-4931-a17b-56b7d1809a31 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1742 microversion: 2.20 time: 0.154736 Sep 09 01:59:08.659331 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 507/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:08 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:08.810285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:08.810812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:08.817321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.817805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.818246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.818929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.819380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.819798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.833683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d HTTP/1.1 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:08.835201 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.836859 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '875530d8-7896-4c8d-ad2b-ec715b49421d'} Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:08.837839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.839380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.840876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:08.840876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-57f37836-4c1d-44ad-88bc-9212b703ff4a tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 404 len: 111 microversion: 2.1 time: 0.030670 Sep 09 01:59:08.840876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 547/1054] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:59:08 2022] DELETE /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:08.846046 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:08.846655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 875530d8-7896-4c8d-ad2b-ec715b49421d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:08.852440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.852921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.853415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.854101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:08.854555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:08.855012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:08.868900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d HTTP/1.1 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:59:08.870610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.872816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '875530d8-7896-4c8d-ad2b-ec715b49421d'} Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:08.873652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. Sep 09 01:59:08.874852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:08.876153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 875530d8-7896-4c8d-ad2b-ec715b49421d could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:08.876153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7b05ce1c-69ee-46cf-81f3-12a83621a286 tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d" status: 404 len: 111 microversion: 2.1 time: 0.030322 Sep 09 01:59:08.876153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 508/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:08 2022] GET /compute/v2.1/servers/875530d8-7896-4c8d-ad2b-ec715b49421d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:09.684824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:09.685384 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:09.691188 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:09.691660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:09.692085 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:09.692754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:09.693228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:09.693645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:09.820940 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:09.828949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:09.830399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:09.831544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-52d4f30b-c391-4e2d-9c28-1fd6d11143da tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1742 microversion: 2.20 time: 0.151322 Sep 09 01:59:09.832100 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 548/1056] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:09 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:10.012780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:10.013312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:10.019669 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.020148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.020617 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:10.021327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.021783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.022205 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:10.035759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d HTTP/1.1 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:59:10.037319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.038860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d'} Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:10.039747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.041249 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.042640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:10.042640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-12936712-6d03-403f-9333-48a216beca2b tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 404 len: 111 microversion: 2.1 time: 0.029713 Sep 09 01:59:10.042640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 509/1057] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 01:59:10 2022] DELETE /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:10.047632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:10.048267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] [instance: 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:10.054284 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.054773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.055210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:10.055897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.056354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.056777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:10.070223 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] HTTP exception thrown: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Request method failure captured: Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d HTTP/1.1 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpt0z36AA2hRqFo_bscMxLU1SwZv0wMPFUZjGD44p1urQHKalFtgp3Y7lh_suNavuLFUIRi6ozhxFYEpKQ5zdnMFTt6UeoQruJBSsxXSomuzwAUnyW8HGLrjgxCzOOhHv8h-C9bBywYEgX3JWdGRuzGB0SqfisMZe3agyLae3I5T0dc Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:10.071748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1ed13a0f61d34a80898093dc1d8e6610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1ed13a0f61d34a80898093dc1d8e6610", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 1ed13a0f61d34a80898093dc1d8e6610 Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1971260045 Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 83f9dc8c41604f0e86eaf57202285cc4 Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeTestJSON-1971260045-project Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.073431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d'} Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:10.074373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. Sep 09 01:59:10.075845 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:10.077354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] Returning 404 to user: Instance 10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:10.077354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b4c5a3bc-3bf9-445a-9e7d-68b7286d299f tempest-AttachVolumeTestJSON-1971260045 tempest-AttachVolumeTestJSON-1971260045-project] 10.222.0.15 "GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d" status: 404 len: 111 microversion: 2.1 time: 0.029279 Sep 09 01:59:10.077354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 549/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 01:59:10 2022] GET /compute/v2.1/servers/10a8ebe2-0edb-49f8-90bc-ef5ecf93d57d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:10.857399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:10.858421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:10.870221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.873172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.874009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:10.875297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:10.875943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:10.876540 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:11.052484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:11.062996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:11.067162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:11.068822 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1c9c85c0-023d-428e-acf9-7ce2f5c0d2d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.216763 Sep 09 01:59:11.069976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 510/1059] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:10 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:12.096396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:12.097001 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:12.106143 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:12.107714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:12.108156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:12.109136 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:12.110271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:12.110858 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:12.283303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:12.292049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:12.295719 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:12.297116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f8c001a7-c22b-4192-8889-b2e7a90f3114 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.205242 Sep 09 01:59:12.313084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 550/1060] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:12 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:13.326632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:13.327700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:13.336365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:13.336884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:13.338970 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:13.343197 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:13.344123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:13.344573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:13.709198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:13.742906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:13.755661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:13.756938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-571849ff-0219-428e-8e18-ba95b2a65176 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.438993 Sep 09 01:59:13.760013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 511/1061] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:13 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:14.805192 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:14.805957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:14.813327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:14.814979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:14.816160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:14.817214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:14.817954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:14.818871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:15.007891 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:15.019645 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:15.022055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:15.023997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-aaaf0834-34ea-43ee-9edb-e37f16c50984 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.223608 Sep 09 01:59:15.025098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 551/1062] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:14 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:15.644013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-86b08d53-fba7-4aa2-8477-ba80f94f69ee tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Action: 'create', calling method: .version_select at 0x7f87dbdd6550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-549930019", "metadata": {"Type": "work"}}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-86b08d53-fba7-4aa2-8477-ba80f94f69ee tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 121 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:59:15.653244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-549930019", "metadata": {"Type": "work"}}} Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:59:15.654981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-549930019', 'metadata': {'Type': 'work'}}}} Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise error Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.656035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 01:59:15.657677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 01:59:15.658883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 01:59:15.658883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.658883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-86b08d53-fba7-4aa2-8477-ba80f94f69ee tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.658883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-86b08d53-fba7-4aa2-8477-ba80f94f69ee tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137937 Sep 09 01:59:15.658883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 512/1063] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 01:59:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 01:59:15.669266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-696b82e1-c5ee-4abc-8a42-9b402e26d2a7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Action: 'create', calling method: .version_select at 0x7f87d93f0af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381243643", "metadata": {"Type": "work"}}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-696b82e1-c5ee-4abc-8a42-9b402e26d2a7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 120 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:15.674865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381243643", "metadata": {"Type": "work"}}} Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: Sep 09 01:59:15.676448 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1381243643', 'metadata': {'Type': 'work'}}}} Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise error Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi '0' Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.677446 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 01:59:15.678785 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 01:59:15.680064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 01:59:15.680064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.680064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-696b82e1-c5ee-4abc-8a42-9b402e26d2a7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.680064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-696b82e1-c5ee-4abc-8a42-9b402e26d2a7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011769 Sep 09 01:59:15.680064 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 552/1064] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 01:59:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 01:59:15.687492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-abe59362-0aae-43cc-811f-86360f13babb tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Action: 'create', calling method: .version_select at 0x7f87d8650c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597126324", "metadata": {"Type": "work"}}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-abe59362-0aae-43cc-811f-86360f13babb tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 119 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:59:15.691191 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597126324", "metadata": {"Type": "work"}}} Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:59:15.692808 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597126324', 'metadata': {'Type': 'work'}}}} Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise error Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi '' Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.693811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 01:59:15.695387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 01:59:15.696624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 01:59:15.696624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.696624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-abe59362-0aae-43cc-811f-86360f13babb tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.696624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-abe59362-0aae-43cc-811f-86360f13babb tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009623 Sep 09 01:59:15.697195 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 513/1065] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Sep 9 01:59:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 01:59:15.702987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7f3b0528-8121-4720-b5a9-3779fb73d89d tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Calling method '.version_select at 0x7f87dbd9d8b0>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:15.733368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-7f3b0528-8121-4720-b5a9-3779fb73d89d tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] HTTP exception thrown: Volume tempest-invalid-919646472 could not be found. Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7f3b0528-8121-4720-b5a9-3779fb73d89d tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-919646472 HTTP/1.1 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:15.735407 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Volume tempest-invalid-919646472 could not be found. Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'tempest-invalid-919646472'} Sep 09 01:59:15.736752 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-919646472 could not be found. (HTTP 404) (Request-ID: req-40199f29-3fee-4e51-b934-e4739e913eda) Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.737600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:59:15.738795 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-919646472 could not be found. Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:15.739965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-919646472 could not be found. Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-919646472 could not be found. Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7f3b0528-8121-4720-b5a9-3779fb73d89d tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 404 to user: Volume tempest-invalid-919646472 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7f3b0528-8121-4720-b5a9-3779fb73d89d tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-919646472" status: 404 len: 98 microversion: 2.1 time: 0.038057 Sep 09 01:59:15.743386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 553/1066] 10.222.0.15 () {58 vars in 1215 bytes} [Fri Sep 9 01:59:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-919646472 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 01:59:15.750461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-457bbef2-6559-4734-ad6d-e2ee72bf7b39 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003976 Sep 09 01:59:15.751096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 514/1067] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Sep 9 01:59:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 01:59:15.763600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9ad6c45d-8ff8-40a9-8a41-b7ac06af639e tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004515 Sep 09 01:59:15.764538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 554/1068] 10.222.0.15 () {58 vars in 1137 bytes} [Fri Sep 9 01:59:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 01:59:15.774476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-30e87086-7efc-41f4-83c0-717f3ecde2e7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Calling method '.version_select at 0x7f87dbe0e3a0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:15.806807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-30e87086-7efc-41f4-83c0-717f3ecde2e7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] HTTP exception thrown: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-30e87086-7efc-41f4-83c0-717f3ecde2e7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/os-volumes/8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 HTTP/1.1 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 01:59:15.808927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '8a2c7afa-df18-4cb7-adc1-5d78b2c62b58'} Sep 09 01:59:15.810569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. (HTTP 404) (Request-ID: req-4eec2fd8-d6c4-439e-8692-0825a1718351) Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.811482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 01:59:15.812607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 01:59:15.813911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-30e87086-7efc-41f4-83c0-717f3ecde2e7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 404 to user: Volume 8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-30e87086-7efc-41f4-83c0-717f3ecde2e7 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/8a2c7afa-df18-4cb7-adc1-5d78b2c62b58" status: 404 len: 109 microversion: 2.1 time: 0.040674 Sep 09 01:59:15.815206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 515/1069] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 01:59:15 2022] DELETE /compute/v2.1/os-volumes/8a2c7afa-df18-4cb7-adc1-5d78b2c62b58 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:15.822102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ea4f41a6-ea3a-4ca6-b164-85add99aab80 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Calling method '.version_select at 0x7f87dbe3c160>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:15.854998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-ea4f41a6-ea3a-4ca6-b164-85add99aab80 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] HTTP exception thrown: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ea4f41a6-ea3a-4ca6-b164-85add99aab80 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Request method failure captured: Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/os-volumes/12c9dfdc-66f3-4aa4-b176-8e705059eda6 HTTP/1.1 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp3zcxWBQ0wDzWS0c6Hhbo_ooMzoQtO7--gPHq2EQw4ENm9X21sbr88hCeV2lBiSY5wFKwuDCzOzksiR-la6nXxJ3YakhFO5Wr0mYNSYFTrRlSn0ECwc68jlE5ChMfeNnEvMJXQsN2awrBbmINjSK5a1JWbYUpxUIXkETL-bhXUGQw4 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 01:59:15.857003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2acf1bb82b24fb6b170b994658c8c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2acf1bb82b24fb6b170b994658c8c9e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2acf1bb82b24fb6b170b994658c8c9e Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-VolumesNegativeTest-1130411585 Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: f7613fad38a3428492dae4f987c32447 Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-VolumesNegativeTest-1130411585-project Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '12c9dfdc-66f3-4aa4-b176-8e705059eda6'} Sep 09 01:59:15.858630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. (HTTP 404) (Request-ID: req-12b3d43a-4ef7-4f0b-87ae-4ac0d4fe6528) Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.859478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 01:59:15.860641 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 01:59:15.861807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ea4f41a6-ea3a-4ca6-b164-85add99aab80 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] Returning 404 to user: Volume 12c9dfdc-66f3-4aa4-b176-8e705059eda6 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ea4f41a6-ea3a-4ca6-b164-85add99aab80 tempest-VolumesNegativeTest-1130411585 tempest-VolumesNegativeTest-1130411585-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/12c9dfdc-66f3-4aa4-b176-8e705059eda6" status: 404 len: 109 microversion: 2.1 time: 0.040814 Sep 09 01:59:15.863031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 555/1070] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Sep 9 01:59:15 2022] GET /compute/v2.1/os-volumes/12c9dfdc-66f3-4aa4-b176-8e705059eda6 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 01:59:16.055203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:16.055825 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:16.077283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:16.077784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:16.078225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:16.078938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:16.079407 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:16.080055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:16.232788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:16.241934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:16.243370 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:16.244535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7c19c8c7-9cb1-443a-a9f9-c1966bca9eef tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.195768 Sep 09 01:59:16.245102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 516/1071] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:16 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:17.273799 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:17.275486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:17.283124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:17.284562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:17.286204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:17.287321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:17.287791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:17.288216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:17.502431 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:17.514777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:17.516900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:17.521437 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2c8b87d9-8a75-4bd3-aaa0-73e9da158981 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.253129 Sep 09 01:59:17.524045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 556/1072] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:17 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:18.550308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:18.552105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:18.554855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:18.560603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:18.561420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:18.562279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:18.563514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:18.564194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:18.564979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:18.727535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:18.740473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:18.742187 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:18.743495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-8ce9c8ff-a9b8-4f5b-b7c0-1e460197ac3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.197274 Sep 09 01:59:18.744049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 517/1073] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:18 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:19.772304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:19.773345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:19.781687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:19.782186 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:19.782633 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:19.783523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:19.783989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:19.784422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:19.989045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:19.999489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:20.001361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:20.002865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-78e2e645-96a3-4cfb-8b22-11e349d8b260 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.234628 Sep 09 01:59:20.003737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 557/1074] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:19 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:21.041847 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:21.042613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:21.049690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:21.050068 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:21.050606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:21.051393 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:21.051886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:21.053136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:21.190478 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:21.198662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:21.200112 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:21.201308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d718f44e-0b66-4f10-84d5-23134d887f39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1737 microversion: 2.20 time: 0.176017 Sep 09 01:59:21.202212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 518/1075] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:21 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:22.227455 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:22.228181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:22.232634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:22.236746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:22.237260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:22.237698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:22.238388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:22.238840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:22.239256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:22.438318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:22.447613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:22.449559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:22.450702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ec1f8fdd-31d3-4542-906c-58b3b886e000 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1719 microversion: 2.20 time: 0.227243 Sep 09 01:59:22.452048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 558/1076] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:22 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:23.476615 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:23.477250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:23.484385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:23.484865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:23.485327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:23.486020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:23.486473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:23.486897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:23.612383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:23.620610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:23.622060 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:23.623271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1aa65eb1-3c70-4fa1-ae17-d27ee1cf8e1a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1719 microversion: 2.20 time: 0.150519 Sep 09 01:59:23.623826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 519/1077] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:23 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:24.649383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:24.649987 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:24.658254 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:24.658686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:24.659112 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:24.659792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:24.660236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:24.660648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:24.795490 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:24.803606 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:24.805038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:24.806236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-63b51f24-d2b8-43c2-a767-30536be79058 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1722 microversion: 2.20 time: 0.160789 Sep 09 01:59:24.806872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 559/1078] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:24 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:24.831564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4071e86-74da-41db-abac-7a04c08acacd"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:24.833997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:24.840941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:24.841464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:24.841899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:24.842590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:24.843045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:24.843470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:24.922929 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:25.123981 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2d026a87-d139-4b7e-9c1b-a2bf05718e7e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296160 Sep 09 01:59:25.124900 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 520/1079] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Sep 9 01:59:24 2022] POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 01:59:25.188605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "name": "network-vif-unplugged", "status": "completed", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:25.199303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:25.199853 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:25.200489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:25.211990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.compute.server_external_events [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] Unable to find a host for instance 86c66864-02f8-472d-9eaa-493d8b436cea. Dropping event network-vif-unplugged {{(pid=126895) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 01:59:25.212967 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-b2c6ae01-3a54-4bb6-bb27-a9c98eb80ffe req-4796b8de-fb48-4f4b-bc9a-5a92e3f8b636 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028124 Sep 09 01:59:25.213654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 560/1080] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 01:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 01:59:25.255710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 01:59:25.256306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:25.263766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:25.264316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:25.264792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:25.265636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:25.266092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:25.266509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:25.295408 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126896) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 01:59:25.362365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b9056876-0cde-4de6-9edb-78020b05ea41 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/action" status: 202 len: 0 microversion: 2.20 time: 0.111709 Sep 09 01:59:25.362995 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 521/1081] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 01:59:25 2022] POST /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 01:59:25.371638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:25.372542 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:25.378617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:25.379094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:25.379523 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:25.380206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:25.380655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:25.381102 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:25.514199 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:25.522865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:25.524310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:25.525502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e6f8a186-026d-43a1-9d1b-5468d13d98bd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1748 microversion: 2.20 time: 0.157989 Sep 09 01:59:25.526046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 561/1082] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:25 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:26.551639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:26.552251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:26.558704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:26.559192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:26.559624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:26.560318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:26.560772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:26.561237 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:26.698771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:26.707274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:26.708690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:26.709864 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-62dcab03-fd72-48e6-8374-4a49c3444580 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1748 microversion: 2.20 time: 0.162779 Sep 09 01:59:26.710583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 522/1083] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:26 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:27.736368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:27.736965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:27.743315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:27.743796 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:27.744229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:27.744913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:27.746039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:27.746524 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:27.873267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:27.881711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:27.883125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:27.884263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d65259a4-7186-4525-b240-3136e98e3c2d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.151905 Sep 09 01:59:27.884812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 562/1084] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:27 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:28.908529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:28.909194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:28.915500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:28.915978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:28.916399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:28.917693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:28.918145 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:28.918563 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:29.054263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:29.065918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:29.067327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:29.068527 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d4718862-8368-4138-88a8-bf23e1ae416c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.163812 Sep 09 01:59:29.093089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 523/1085] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:28 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:30.113921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:30.116181 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:30.133635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:30.137152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:30.139353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:30.142334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:30.143733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:30.145591 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:30.313182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:30.321918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:30.324160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:30.325638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-19cfce27-1017-475d-86aa-2f8bf7ea1e5f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.217399 Sep 09 01:59:30.326361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 563/1086] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:30 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 01:59:31.352234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:31.353701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:31.361590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:31.362221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:31.362786 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:31.363753 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:31.364275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:31.364800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:31.514181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:31.522882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:31.524316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:31.525524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5232f899-9d64-47e3-8a40-25e1a890291a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.178005 Sep 09 01:59:31.526089 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 524/1087] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:31 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:32.551253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:32.552289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:32.559984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:32.560462 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:32.560915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:32.561671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:32.565538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:32.566219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:32.745697 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:32.755266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:32.756686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:32.757885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b6e51fe8-4a25-459a-80ba-be1b2faed7d0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.211061 Sep 09 01:59:32.759067 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 564/1088] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:32 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:33.784972 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:33.785601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:33.795616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:33.796179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:33.796679 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:33.797606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:33.798148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:33.798631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:33.957670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:33.967165 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:33.972065 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:33.973583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0bb4dcd9-cbeb-47a3-bfab-c6407a0eb36e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.192540 Sep 09 01:59:33.974418 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 525/1089] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:33 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:35.000124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:35.000892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:35.007558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:35.008044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:35.008477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:35.019917 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:35.020620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:35.021308 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:35.179083 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:35.188586 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:35.190205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:35.191503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bc5f171b-43e1-4be8-a90f-fb184bb4208b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.195225 Sep 09 01:59:35.192155 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 565/1090] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:34 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:36.218666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:36.219271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:36.225901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:36.226379 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:36.226810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:36.227512 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:36.227966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:36.228386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:36.391241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:36.406794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:36.408843 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:36.410439 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4318e60e-c22a-42b0-8bb2-a4cf08a154c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.195669 Sep 09 01:59:36.423061 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 526/1091] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:36 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:37.436156 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:37.436797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:37.443417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:37.443906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:37.444340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:37.445027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:37.445541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:37.445961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:37.595076 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:37.605288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:37.606698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:37.607885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d6470cf8-fd21-4a1d-94c5-b40b952d614a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.176206 Sep 09 01:59:37.608441 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 566/1092] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:37 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:38.633595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:38.634192 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:38.640752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:38.641273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:38.641710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:38.642400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:38.642855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:38.643277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:38.779095 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:38.788019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:38.789483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:38.790638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-93ad81a6-50b5-4789-9542-17cf0ff99cb0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.161093 Sep 09 01:59:38.799996 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 527/1093] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:38 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:39.815562 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:39.816206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:39.823569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:39.824055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:39.824486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:39.825214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:39.825663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:39.826077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:39.830206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=85 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:39.990458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:40.000055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:40.001544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:40.002961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f24328cb-d1dc-44ef-b631-13be73acdcec tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.191204 Sep 09 01:59:40.003232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 567/1094] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:39 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:41.030124 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:41.030728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:41.038277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:41.038277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:41.038277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:41.039819 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:41.040300 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:41.040737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:41.191092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:41.200736 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:41.202228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:41.203385 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-40fa7c5a-2147-41ed-ac98-759fbcbf2118 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.177564 Sep 09 01:59:41.204114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 528/1095] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:41 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:42.228486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:42.229108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:42.235322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:42.235800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:42.236228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:42.236898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:42.237381 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:42.237810 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:42.365541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:42.382265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:42.383695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:42.384855 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7b01e0b4-b8ae-488f-8424-5f32f1cf3d78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.160245 Sep 09 01:59:42.386025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 568/1096] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:42 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:43.410823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:43.411456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:43.419283 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:43.419770 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:43.420201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:43.420884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:43.421361 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:43.422297 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:43.585740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:43.595123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:43.596917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:43.598308 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-137a8b3d-4110-4b99-b35f-4174ced4fd88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.191931 Sep 09 01:59:43.598952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 529/1097] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:43 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:44.633239 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:44.633923 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:44.640860 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:44.641379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:44.641813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:44.642502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:44.642953 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:44.643374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:44.772808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:44.782655 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:44.784193 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:44.785468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-247eec42-1c08-4d6c-8da0-e25ff7c18d66 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.156133 Sep 09 01:59:44.786107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 569/1098] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:44 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:45.812161 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:45.812723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:45.819097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:45.819578 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:45.820006 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:45.820686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:45.821162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:45.821583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:45.952438 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:45.961043 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:45.962502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:45.964147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9f4534fb-2e19-4754-9501-ff6b2794e7f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.155938 Sep 09 01:59:45.964702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 530/1099] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:45 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:46.989847 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:46.990700 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:46.997968 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:46.998482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:46.998935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:46.999627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:47.000077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:47.000494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:47.128823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:47.137340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:47.138758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:47.139906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c41c1c37-9dca-45ad-8560-9344b7f3ece0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.153921 Sep 09 01:59:47.140454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 570/1100] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:46 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:48.165152 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:48.165698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:48.172266 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:48.172752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:48.173217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:48.173907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:48.174360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:48.174780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:48.300600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:48.309603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:48.311041 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:48.312194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c9c48bd8-cdc0-4afa-9601-bed0a2a790e1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.151078 Sep 09 01:59:48.312761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 531/1101] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:48 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:49.337686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:49.338297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:49.344679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:49.345260 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:49.345699 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:49.346382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:49.346835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:49.347256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:49.478715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:49.487751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:49.489390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:49.490818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b342cdb8-02e6-4f3f-8e1c-99383266bcb3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.157010 Sep 09 01:59:49.491372 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 571/1102] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:49 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:50.515425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:50.516033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:50.518420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:50.523613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:50.524097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:50.524542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:50.525260 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:50.525765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:50.526141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:50.656909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:50.665452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:50.666885 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:50.668074 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-bb479856-8a65-4785-b713-1b7d61758c97 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.156541 Sep 09 01:59:50.668631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 532/1103] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:50 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:51.693320 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:51.693955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:51.700687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:51.701205 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:51.701638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:51.702312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:51.702757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:51.703168 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:51.832158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:51.841287 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:51.842711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:51.843849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5d4ae261-b2ba-4661-a661-7bce57744a50 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.154490 Sep 09 01:59:51.844394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 572/1104] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:51 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:52.869312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:52.869958 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:52.876671 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:52.877201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:52.877636 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:52.878415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:52.878989 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:52.879414 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:53.005784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:53.014186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:53.015652 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:53.016797 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-84dd73af-36c5-4129-8ad1-91c3e9854977 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.151809 Sep 09 01:59:53.017391 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 533/1105] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:52 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:54.042417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:54.043241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:54.045816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=30 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:54.051217 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:54.051716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:54.052154 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:54.052882 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:54.053368 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:54.053794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:54.246797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:54.255463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:54.256985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:54.258179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5c213722-710d-45e6-89ff-6a06ebbaf535 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.220325 Sep 09 01:59:54.258736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 573/1106] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:54 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:55.284202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:55.284852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:55.291413 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:55.291902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:55.292340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:55.293039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:55.293526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:55.293950 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:55.297884 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 01:59:55.429948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:55.439741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:55.441307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:55.442483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-27262950-5619-4843-9ad7-523bb0d10db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.162653 Sep 09 01:59:55.443048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 534/1107] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:55 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:56.468160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:56.468976 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:56.475495 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:56.475972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:56.476398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:56.477082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:56.477534 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:56.478598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:56.614648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:56.623447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:56.624871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:56.626046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1424b4e4-8fa7-4e9f-aeec-23a6585c2443 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.161720 Sep 09 01:59:56.626619 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 574/1108] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:56 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:57.652494 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:57.653140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:57.660252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:57.660733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:57.661190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:57.661882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:57.662333 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:57.662875 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:57.799288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:57.808703 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:57.810179 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:57.811473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0c0e500e-5812-48e3-b548-8574889db6f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.163482 Sep 09 01:59:57.812218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 535/1109] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:57 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 01:59:58.836708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 01:59:58.837328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 01:59:58.843863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:58.844334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:58.844760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:58.845468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 01:59:58.845912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 01:59:58.846326 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 01:59:58.986366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:58.995055 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:58.996466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 01:59:58.997683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3303342a-a05c-44cb-a136-bb154ad3fcf2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.165159 Sep 09 01:59:58.998228 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 575/1110] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 01:59:58 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:00.022655 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:00.023262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:00.030309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:00.030803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:00.031234 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:00.031921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:00.032377 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:00.032804 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:00.159509 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:00.167881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:00.169328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:00.170470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-46385bd6-c925-4a17-a7fc-a704a9f39a3b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.151832 Sep 09 02:00:00.171033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 536/1111] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:00 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:01.195613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:01.196232 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:01.203057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:01.203543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:01.203989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:01.204689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:01.205225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:01.205662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:01.350676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:01.359226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:01.360731 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:01.361938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-763a774b-f9e8-4510-9912-5be067235a55 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.170228 Sep 09 02:00:01.362494 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 576/1112] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:01 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:02.388124 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:02.388735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:02.395275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:02.395757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:02.396290 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:02.396994 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:02.397482 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:02.397908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:02.530593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:02.539334 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:02.541434 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:02.542587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9a0f11a9-97c6-488d-94ef-7b69d5abd3f9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.159005 Sep 09 02:00:02.543148 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 537/1113] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:02 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:03.567640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:03.568350 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:03.575700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:03.576186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:03.576709 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:03.577347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:03.577807 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:03.578230 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:03.677393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "name": "network-vif-plugged", "status": "completed", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:00:03.688108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:03.689270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:03.689884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:03.732218 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:03.744141 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:03.754142 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:03.755397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-94201909-7761-45ae-852b-d08ded6cb210 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.191687 Sep 09 02:00:03.759476 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 538/1114] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:03 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:03.856125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] Creating event network-vif-plugged:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 02:00:03.861676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-f1414474-35dd-4288-bcd1-eefdf8779271 req-8d302ad7-fc1d-44af-9d1e-cb136a177ea9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407853 Sep 09 02:00:03.862623 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 577/1115] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:04.784060 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:04.784592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:04.790630 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:04.791117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:04.791553 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:04.792244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:04.792698 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:04.793140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:04.935045 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:04.944136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:04.945771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:04.947498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-960e4c90-7641-4069-99d8-40ac3b648e06 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.168005 Sep 09 02:00:04.948053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 539/1116] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:04 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:05.972684 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:05.973401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:05.980037 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:05.980522 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:05.980955 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:05.981670 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:05.982188 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:05.982650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:06.116525 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:06.124997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:06.126440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:06.127575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bfc6cadb-a6b9-422e-a16f-b16cb2fc301d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1806 microversion: 2.20 time: 0.159598 Sep 09 02:00:06.128436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 578/1117] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:05 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:07.154595 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:07.155200 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:07.161353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:07.161826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:07.162252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:07.162930 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:07.163399 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:07.163816 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:07.304390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:07.314013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:07.315539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:07.316695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b8f7b7ad-4021-46a8-9839-cc18625e7c14 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1793 microversion: 2.20 time: 0.166441 Sep 09 02:00:07.317460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 540/1118] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:00:07 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1793 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:00:45.222737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:45.223299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:45.225463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=11 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:00:45.226179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=67 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:00:45.232051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:45.232568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:45.233004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:45.233725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:45.234178 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:45.234596 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:45.258313 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-43cf095c-0474-4970-acee-16ac3b0f4415 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/ips" status: 200 len: 149 microversion: 2.1 time: 0.040433 Sep 09 02:00:45.258852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 579/1119] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Sep 9 02:00:45 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:46.584896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75c8316c-e269-4756-b0e0-2c8dbc9d4417"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:00:46.587387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:46.589569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=17 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:00:46.590229 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=41 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:00:46.595844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:46.596319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:46.596778 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:46.597495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:46.597949 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:46.598369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:46.873461 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ed354433-8fe9-411e-8c93-346bad571e3e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "POST /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292264 Sep 09 02:00:46.874072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 541/1120] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 02:00:46 2022] POST /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:54.506013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:54.506550 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:54.513163 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:54.513651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:54.514086 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:54.514777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:54.515227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:54.515650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:54.595671 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'services' on Instance uuid cb71f445-63cd-4f1e-8a16-2e6921989dae {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:00:54.668678 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a16ad06f-5a92-4c20-a5d0-7f74eaafd5df tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments/75c8316c-e269-4756-b0e0-2c8dbc9d4417" status: 202 len: 0 microversion: 2.1 time: 0.166530 Sep 09 02:00:54.669297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 580/1121] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 02:00:54 2022] DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments/75c8316c-e269-4756-b0e0-2c8dbc9d4417 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 02:00:54.678518 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:54.680798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:54.687133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:54.687622 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:54.688055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:54.688747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:54.689240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:54.689662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:54.721913 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a0bf76cb-ce21-417b-b1a1-3c1d3a9f74d6 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047996 Sep 09 02:00:54.722484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 542/1122] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 02:00:54 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:55.735114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:55.737478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:55.744568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:55.745050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:55.745507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:55.746191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:55.746648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:55.747069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:55.775922 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-536bdc9b-7aab-42d6-b389-79744b679010 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Sep 09 02:00:55.776461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 581/1123] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 02:00:55 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:56.787855 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:56.790533 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:56.797034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:56.797540 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:56.797976 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:56.798695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:56.799146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:56.799560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:56.828546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a7769b05-fc8d-461f-9ab5-1616b8e97f4c tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044603 Sep 09 02:00:56.829104 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 543/1124] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 02:00:56 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 02:00:56.891060 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:56.891539 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:56.897910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:56.899443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:56.899443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:56.900092 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:56.900544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:56.900965 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:56.925486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:00:56.998603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-386eefc8-d34a-4e9a-a030-b257c930b87f tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 204 len: 0 microversion: 2.1 time: 0.111073 Sep 09 02:00:57.002307 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 582/1125] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:00:56 2022] DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:00:57.007390 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:57.008601 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:57.014528 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:57.015011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:57.015444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:57.016133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:57.016587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:57.017008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:57.146547 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:57.154752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ddd29d1f-6713-48c7-8dab-24ceccf727ef tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1680 microversion: 2.1 time: 0.151291 Sep 09 02:00:57.155309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 544/1126] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:00:57 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:00:58.178377 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:58.178996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:58.185850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:58.186328 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:58.186756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:58.187434 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:58.187881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:58.188295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:58.318842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:58.326549 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a702a495-0ac4-4026-9b2f-83c51b5781b1 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1680 microversion: 2.1 time: 0.152510 Sep 09 02:00:58.327118 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 583/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:00:58 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:00:59.340844 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:59.342616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:59.352376 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.353323 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.353991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.354947 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.355614 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.356580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.392828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:00:59.503687 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3829fc39-91c9-4d45-bd5b-170422d43bca tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 204 len: 0 microversion: 2.1 time: 0.175030 Sep 09 02:00:59.509310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 545/1128] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:00:59 2022] DELETE /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:00:59.514904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:59.516835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:59.526641 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.527130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.527562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.532092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.532092 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.532489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.571673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1", "tag": "ee570d29-fbda-4579-8583-80c17ac6a76d"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:00:59.583763 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.584516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.584935 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.596706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] Creating event network-changed:ee570d29-fbda-4579-8583-80c17ac6a76d for instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 on hv-cinder-85221 Sep 09 02:00:59.602512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-85046118-0606-41dc-839a-d564c0f8e449 req-f6af8833-6307-4603-9e56-9b17ed2fc412 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270283 Sep 09 02:00:59.603411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 584/1129] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:00:59.608440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:00:59.609157 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:00:59.615784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.615949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.616279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.616958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:00:59.617461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:00:59.617879 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:00:59.885200 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:59.893682 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-04fd503d-ec2b-4829-bf2b-35bb34d30367 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1680 microversion: 2.1 time: 0.386148 Sep 09 02:00:59.904415 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 546/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:00:59 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1680 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:00:59.909318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:00:59.922107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-dd8f17e7-f0f5-4e6a-8cb0-c420235b8b74 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1576 microversion: 2.1 time: 0.317414 Sep 09 02:00:59.922924 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 585/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:00:59 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1576 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:00.379792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71f445-63cd-4f1e-8a16-2e6921989dae", "name": "network-vif-deleted", "tag": "9a6d5ee2-7a02-445f-b3ae-9eab82538476"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:00.390090 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.390569 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.391010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.405651 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] Creating event network-vif-deleted:9a6d5ee2-7a02-445f-b3ae-9eab82538476 for instance cb71f445-63cd-4f1e-8a16-2e6921989dae on hv-cinder-85221 Sep 09 02:01:00.410860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-8bcce035-7b2a-4451-ad51-5461768b4ed0 req-dd4cb392-8b07-42a6-b279-3def4ea32fba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101807 Sep 09 02:01:00.415439 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 547/1132] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:01:00.922466 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:00.923090 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:00.930122 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.930842 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.931282 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.931973 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.932424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.932844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.947520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:00.949371 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:00.956055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.956529 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.956952 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.957673 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.958122 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.958542 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.966851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:00.967341 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:00.967773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:00.968216 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lazy-loading 'fault' on Instance uuid cb71f445-63cd-4f1e-8a16-2e6921989dae {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:01:01.029714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b569b91d1045dc8257c8aaa868842a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37932fe56b864be6b57f92a76e92cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:01.037827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6c762ef6-6eaf-48f5-a43a-eefb0ce5e773 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 200 len: 1332 microversion: 2.1 time: 0.124600 Sep 09 02:01:01.038394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 586/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:00 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:01.154773 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:01.163105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-3a30035d-7ad5-4f39-993c-ea078ff40a14 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1576 microversion: 2.1 time: 0.220463 Sep 09 02:01:01.164572 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 548/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:00 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:01:02.062497 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:02.063271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:02.070634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:02.071121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:02.071548 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:02.072234 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:02.072680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:02.073116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:02.086159 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae HTTP/1.1 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:02.087826 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:02.089369 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'cb71f445-63cd-4f1e-8a16-2e6921989dae'} Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:02.090334 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:02.092111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:02.093696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:02.093696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fd7f345a-d824-4e40-a697-b681914f03ab tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 404 len: 111 microversion: 2.1 time: 0.031403 Sep 09 02:01:02.093696 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 587/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:02 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:02.097922 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7ee944bc-74c7-4f82-a084-2cc859d345aa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '.version_select at 0x7f87d86c0b80>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:02.117619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7ee944bc-74c7-4f82-a084-2cc859d345aa tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317751646" status: 202 len: 0 microversion: 2.1 time: 0.022770 Sep 09 02:01:02.118185 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 549/1136] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Sep 9 02:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317751646 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 02:01:02.187311 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:02.188032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:02.194837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:02.195484 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:02.196027 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:02.197237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:02.197877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:02.198588 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:02.281482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:02.290986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-f593b9d7-482d-4ea8-a9f1-fbdcccb79fb2 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 200 len: 1390 microversion: 2.1 time: 0.107694 Sep 09 02:01:02.291594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 588/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:02 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 1390 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:02.426257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1", "name": "network-vif-deleted", "tag": "ee570d29-fbda-4579-8583-80c17ac6a76d"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:02.437001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:02.437538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:02.437959 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:02.448686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] Creating event network-vif-deleted:ee570d29-fbda-4579-8583-80c17ac6a76d for instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 on hv-cinder-85221 Sep 09 02:01:02.453454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-c35b42bd-df38-458d-b1dd-57bed3174bf6 req-44698e03-5b78-4baf-abbc-b778562d9689 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 Sep 09 02:01:02.454055 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 550/1138] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:01:03.314742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:03.315283 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:03.323262 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:03.323740 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:03.324175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:03.324849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:03.325322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:03.325736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:03.339957 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] HTTP exception thrown: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Request method failure captured: Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 HTTP/1.1 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpwWp8jRGrzC7Vx_ZyM-UDZYm9t2sBGtaD39VaTi9b1HhQBcs0BI3DB7Tep2LYZTdqcW7wGKlFvwE1CbNkvnRtd2yrZj5WEo749nI0eTvfHRTypwirH_Wz4gwIGzPxHZZAS7eDd3uJGuxHp7neyWVS0HuBaxMbHqJjs3wOfyA_LCMS0 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:03.341547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_826001ffb29b4d42a5c299154c17b93e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: fa5465b818f34778a1d51278653488ed Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. Sep 09 02:01:03.343230 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1'} Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:03.344049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. Sep 09 02:01:03.345318 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:03.346445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Returning 404 to user: Instance 2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:03.346445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-83bb54d4-86d8-47ef-860d-8a5dd4ff0014 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1" status: 404 len: 111 microversion: 2.1 time: 0.032161 Sep 09 02:01:03.346445 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 589/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:03 2022] GET /compute/v2.1/servers/2b5fc762-01bb-44ed-a72d-0aec8f4ce7f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:04.027525 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:04.028140 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:04.034255 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:04.034741 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:04.035175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:04.035859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:04.036313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:04.036735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:04.049668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae HTTP/1.1 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:01:04.051293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.052960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'cb71f445-63cd-4f1e-8a16-2e6921989dae'} Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:04.053944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.055944 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.057514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:04.057514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f795f073-f42b-4fa0-875b-d3e2794ecfd0 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 404 len: 111 microversion: 2.1 time: 0.029802 Sep 09 02:01:04.057514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 551/1140] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:04 2022] DELETE /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:04.061527 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:04.062135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: cb71f445-63cd-4f1e-8a16-2e6921989dae] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:04.067938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:04.068417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:04.068851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:04.069553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:04.070124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:04.070560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:04.083531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae HTTP/1.1 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:04.085019 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.087137 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'cb71f445-63cd-4f1e-8a16-2e6921989dae'} Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:04.088107 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. Sep 09 02:01:04.089651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:04.091041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance cb71f445-63cd-4f1e-8a16-2e6921989dae could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:04.091041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-60ea83fb-ac1c-4e9a-866a-b96caeb0268e tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae" status: 404 len: 111 microversion: 2.1 time: 0.029155 Sep 09 02:01:04.091041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 590/1141] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:04 2022] GET /compute/v2.1/servers/cb71f445-63cd-4f1e-8a16-2e6921989dae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:05.232012 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:05.232591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:05.241321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.241921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.242589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.243531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.244047 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.244538 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.259718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b HTTP/1.1 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:01:05.261410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.263080 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'd7f74eb0-9fbe-4196-9a06-a6fd8975a76b'} Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:05.264019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.265781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.267997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:05.267997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-814e8363-2dc0-4f10-8aaf-c92d3350c127 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 404 len: 111 microversion: 2.1 time: 0.035082 Sep 09 02:01:05.267997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 552/1142] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:05 2022] DELETE /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:05.272811 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:05.274009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: d7f74eb0-9fbe-4196-9a06-a6fd8975a76b] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:05.280301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.280774 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.281235 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.281919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.282430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.282844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.297547 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b HTTP/1.1 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:05.299044 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'd7f74eb0-9fbe-4196-9a06-a6fd8975a76b'} Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:05.302017 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. Sep 09 02:01:05.303647 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.305406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance d7f74eb0-9fbe-4196-9a06-a6fd8975a76b could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:05.305406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-00b800ba-306f-4713-b425-ccf52d2db431 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b" status: 404 len: 111 microversion: 2.1 time: 0.032179 Sep 09 02:01:05.305406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 591/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:05 2022] GET /compute/v2.1/servers/d7f74eb0-9fbe-4196-9a06-a6fd8975a76b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:05.310863 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:05.311388 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:05.317703 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.318182 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.318613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.319299 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.319747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.320695 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.333710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 HTTP/1.1 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:01:05.335235 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.337429 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'b6f2946f-79f7-4ccb-91df-7125a9e02ad4'} Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:05.338392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.339940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.341440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:05.341440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-c0b91cc1-ed84-46bf-9212-98f6efeaa681 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 404 len: 111 microversion: 2.1 time: 0.030431 Sep 09 02:01:05.341440 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 553/1144] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:05 2022] DELETE /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:05.345294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:05.345902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: b6f2946f-79f7-4ccb-91df-7125a9e02ad4] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:05.351866 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.352343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.352770 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.353464 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:05.353910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:05.354317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:05.367528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 HTTP/1.1 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:05.369039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.370715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'b6f2946f-79f7-4ccb-91df-7125a9e02ad4'} Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:05.371789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. Sep 09 02:01:05.373414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:05.374861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance b6f2946f-79f7-4ccb-91df-7125a9e02ad4 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:05.374861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5e1ebff7-69bd-49b9-aa44-78aa3fbe1196 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4" status: 404 len: 111 microversion: 2.1 time: 0.028809 Sep 09 02:01:05.374861 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 592/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:05 2022] GET /compute/v2.1/servers/b6f2946f-79f7-4ccb-91df-7125a9e02ad4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:06.409138 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:06.409646 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:06.411389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8469534-2b09-4d9d-af78-5295d54a1783", "tag": "9dbbdceb-8367-408d-9f33-9058546b3288"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:06.416589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.417084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.417719 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.418398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.419463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.419883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.422482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.423267 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.423793 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.435370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] Creating event network-changed:9dbbdceb-8367-408d-9f33-9058546b3288 for instance a8469534-2b09-4d9d-af78-5295d54a1783 on hv-cinder-85221 Sep 09 02:01:06.440568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-41b894e2-e017-43ad-a32d-24c2f1f3860c req-ee91f836-77e5-4fcc-9f38-ff523abdeaa1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Sep 09 02:01:06.441333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 593/1146] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:01:06.449450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:01:06.520281 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:06.526680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:06.534114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.534693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.535222 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.536000 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.536528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.537020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.552766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 HTTP/1.1 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:06.554996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.557414 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'ab363ee7-d833-4edb-95de-48d7e54bc297'} Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:06.558252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.559517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.562286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:06.562286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5ea65f83-ce2f-46bf-b670-c9571420f829 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 404 len: 111 microversion: 2.1 time: 0.040756 Sep 09 02:01:06.562286 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 594/1147] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:06 2022] DELETE /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:06.566365 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:06.567263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] [instance: ab363ee7-d833-4edb-95de-48d7e54bc297] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:06.574666 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6140d74a-6586-4e90-93f0-0eed0ae0745b tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 204 len: 0 microversion: 2.1 time: 0.169495 Sep 09 02:01:06.575099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.575804 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.575926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 554/1148] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:06 2022] DELETE /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:01:06.576658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.577627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.578249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.579126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.586116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:06.586942 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:06.594620 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] HTTP exception thrown: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Request method failure captured: Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 HTTP/1.1 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpvWcec24TiZxaWKXkvvw3ZmkUPnljIcFRNUG4nkRWsRGeOTRqOnqE-A4nTnHNT-RGh3PWOOVNxg7wR7k70_sEdJfxt7jO0eiFT3vAWNf1Fkt18vR25kZ_SZoBtG04xue5pK3k17q_9j6wbTLLfF9xjBaKdZ58eF-7DdxxYHGz0ZLsI Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:06.596236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/37932fe56b864be6b57f92a76e92cd09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_37932fe56b864be6b57f92a76e92cd09", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 37932fe56b864be6b57f92a76e92cd09 Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-485599624 Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 04b569b91d1045dc8257c8aaa868842a Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeNegativeTest-485599624-project Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.597963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'ab363ee7-d833-4edb-95de-48d7e54bc297'} Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:06.599421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. Sep 09 02:01:06.600928 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:06.603440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] Returning 404 to user: Instance ab363ee7-d833-4edb-95de-48d7e54bc297 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:06.603440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2f3e1ab6-e23c-48c0-84e4-1deb2e4fcd32 tempest-AttachVolumeNegativeTest-485599624 tempest-AttachVolumeNegativeTest-485599624-project] 10.222.0.15 "GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297" status: 404 len: 111 microversion: 2.1 time: 0.035726 Sep 09 02:01:06.603440 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 595/1149] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:06 2022] GET /compute/v2.1/servers/ab363ee7-d833-4edb-95de-48d7e54bc297 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:06.604204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.604204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.604204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.604204 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:06.604552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:06.604552 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:06.752836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:06.764607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-17a1cef9-a07f-4b57-bba8-fa650bbcac5a tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1579 microversion: 2.1 time: 0.184246 Sep 09 02:01:06.765428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 555/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:06 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1579 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:01:07.789411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:07.790757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:07.799304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:07.800268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:07.800938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:07.802025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:07.802856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:07.803521 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:08.189743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:08.198028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a370021a-6e8d-457b-9fce-f7361cf645c7 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1579 microversion: 2.1 time: 0.413224 Sep 09 02:01:08.198708 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 596/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:07 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1579 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:09.223077 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:09.223839 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:09.235505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:09.235986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:09.236428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:09.237151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:09.237606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:09.238073 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:09.332984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8469534-2b09-4d9d-af78-5295d54a1783", "name": "network-vif-deleted", "tag": "9dbbdceb-8367-408d-9f33-9058546b3288"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:09.348937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:09.349787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:09.350150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:09.365491 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] Creating event network-vif-deleted:9dbbdceb-8367-408d-9f33-9058546b3288 for instance a8469534-2b09-4d9d-af78-5295d54a1783 on hv-cinder-85221 Sep 09 02:01:09.366253 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5465b818f34778a1d51278653488ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826001ffb29b4d42a5c299154c17b93e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:09.371969 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-5aa2e80c-52c4-42f4-b2b9-142ddf32f9fa req-34151ca5-b2e3-4457-b8e1-129c3c83ad47 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045625 Sep 09 02:01:09.372962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 597/1152] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:01:09.375702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b18453d8-0604-4f68-9bbf-e53221e05121 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 200 len: 1392 microversion: 2.1 time: 0.156380 Sep 09 02:01:09.376380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 556/1153] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:09 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:10.406332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:10.407498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: a8469534-2b09-4d9d-af78-5295d54a1783] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:10.414926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.415808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.416337 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.417255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.417878 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.418463 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.432817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] HTTP exception thrown: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Request method failure captured: Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 HTTP/1.1 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpwWp8jRGrzC7Vx_ZyM-UDZYm9t2sBGtaD39VaTi9b1HhQBcs0BI3DB7Tep2LYZTdqcW7wGKlFvwE1CbNkvnRtd2yrZj5WEo749nI0eTvfHRTypwirH_Wz4gwIGzPxHZZAS7eDd3uJGuxHp7neyWVS0HuBaxMbHqJjs3wOfyA_LCMS0 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:10.434777 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_826001ffb29b4d42a5c299154c17b93e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: fa5465b818f34778a1d51278653488ed Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. Sep 09 02:01:10.436432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'a8469534-2b09-4d9d-af78-5295d54a1783'} Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:10.437489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. Sep 09 02:01:10.438831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.440139 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Returning 404 to user: Instance a8469534-2b09-4d9d-af78-5295d54a1783 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:10.440139 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-50d6120b-43ef-46ab-ab8c-105e3acacdde tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783" status: 404 len: 111 microversion: 2.1 time: 0.037216 Sep 09 02:01:10.440139 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 598/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:10 2022] GET /compute/v2.1/servers/a8469534-2b09-4d9d-af78-5295d54a1783 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:10.926495 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:10.927019 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:10.934302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.934790 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.935232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.935933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.936386 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.936810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.941535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:10.953183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] HTTP exception thrown: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Request method failure captured: Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: DELETE /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 HTTP/1.1 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGpwWp8jRGrzC7Vx_ZyM-UDZYm9t2sBGtaD39VaTi9b1HhQBcs0BI3DB7Tep2LYZTdqcW7wGKlFvwE1CbNkvnRtd2yrZj5WEo749nI0eTvfHRTypwirH_Wz4gwIGzPxHZZAS7eDd3uJGuxHp7neyWVS0HuBaxMbHqJjs3wOfyA_LCMS0 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:01:10.955144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_826001ffb29b4d42a5c299154c17b93e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: fa5465b818f34778a1d51278653488ed Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.956607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'c65605f6-ff2d-4119-94d5-1c1af235ce41'} Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:10.957459 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.958769 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.960103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Returning 404 to user: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:10.960103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e638c604-ee4e-4816-96a1-e141d813aa70 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 404 len: 111 microversion: 2.1 time: 0.034207 Sep 09 02:01:10.960103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 557/1155] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:01:10 2022] DELETE /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:10.966148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:10.966863 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] [instance: c65605f6-ff2d-4119-94d5-1c1af235ce41] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:10.973452 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.974016 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.974503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.975257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:10.975769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:10.976256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:10.994210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] HTTP exception thrown: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Request method failure captured: Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 HTTP/1.1 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGpwWp8jRGrzC7Vx_ZyM-UDZYm9t2sBGtaD39VaTi9b1HhQBcs0BI3DB7Tep2LYZTdqcW7wGKlFvwE1CbNkvnRtd2yrZj5WEo749nI0eTvfHRTypwirH_Wz4gwIGzPxHZZAS7eDd3uJGuxHp7neyWVS0HuBaxMbHqJjs3wOfyA_LCMS0 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:10.995739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/826001ffb29b4d42a5c299154c17b93e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_826001ffb29b4d42a5c299154c17b93e", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: 826001ffb29b4d42a5c299154c17b93e Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1611771857 Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: fa5465b818f34778a1d51278653488ed Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestVolumeBootPattern-1611771857-project Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.997161 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'c65605f6-ff2d-4119-94d5-1c1af235ce41'} Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:10.997954 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. Sep 09 02:01:10.999274 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:11.000416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Returning 404 to user: Instance c65605f6-ff2d-4119-94d5-1c1af235ce41 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:11.000416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6a6087f3-ad85-4bbd-a1d8-6706776bdb84 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41" status: 404 len: 111 microversion: 2.1 time: 0.035394 Sep 09 02:01:11.000416 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 599/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:01:10 2022] GET /compute/v2.1/servers/c65605f6-ff2d-4119-94d5-1c1af235ce41 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:01:12.310924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-81d4b73d-c821-4fe3-b86e-bdfb07c58b48 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] Calling method '.version_select at 0x7f87d873b820>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:12.344463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-81d4b73d-c821-4fe3-b86e-bdfb07c58b48 tempest-TestVolumeBootPattern-1611771857 tempest-TestVolumeBootPattern-1611771857-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785472344" status: 202 len: 0 microversion: 2.1 time: 0.037499 Sep 09 02:01:12.351483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 558/1157] 10.222.0.15 () {58 vars in 1260 bytes} [Fri Sep 9 02:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785472344 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 02:01:14.321364 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:14.322639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:14.328919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.329447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.329881 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.330570 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.331023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.331432 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.361320 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-41109d85-dc22-4dc5-b223-56a6192a9db7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments/f4071e86-74da-41db-abac-7a04c08acacd" status: 200 len: 194 microversion: 2.20 time: 0.043974 Sep 09 02:01:14.361919 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 600/1158] 10.222.0.15 () {60 vars in 1454 bytes} [Fri Sep 9 02:01:14 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments/f4071e86-74da-41db-abac-7a04c08acacd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 02:01:14.441550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:14.442033 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:14.449926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.451082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.451840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.452810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.453986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.454581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.542851 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lazy-loading 'services' on Instance uuid 86c66864-02f8-472d-9eaa-493d8b436cea {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:01:14.615032 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-e9f835b4-01d9-41a5-bd47-c94a94017ef1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments/f4071e86-74da-41db-abac-7a04c08acacd" status: 202 len: 0 microversion: 2.20 time: 0.177845 Sep 09 02:01:14.615716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 559/1159] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Sep 9 02:01:14 2022] DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments/f4071e86-74da-41db-abac-7a04c08acacd => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:01:14.624224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:14.626417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:14.632388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.632877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.633344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.634068 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:14.634546 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:14.634912 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:14.638876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:14.667630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4b4f5b77-e30f-4c24-bfa5-f94a9a66da37 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047303 Sep 09 02:01:14.668194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 601/1160] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 02:01:14 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 02:01:15.682795 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:15.686020 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:15.697644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.698153 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.698619 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:15.699296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.699748 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.700653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:15.735888 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d75c0925-41bc-4c35-abea-714dd3ff2360 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058434 Sep 09 02:01:15.736468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 560/1161] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 02:01:15 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:01:15.822013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:15.823148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:15.829088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:15.830482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.830964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.831397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:15.832257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.832621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.833013 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:15.862565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:01:15.945887 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2a3f02b3-8b66-46d8-aa34-d3fcd73259c4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 204 len: 0 microversion: 2.20 time: 0.127818 Sep 09 02:01:15.946817 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 602/1162] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 02:01:15 2022] DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 02:01:15.955826 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:15.956436 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:15.963127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.963612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.964046 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:15.964735 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:15.965211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:15.965637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:16.165626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:16.173881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:16.175343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:16.176500 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-86b877f7-b4c4-4179-8e65-b8ee8a2c1b78 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.224874 Sep 09 02:01:16.177083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 561/1163] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:15 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 02:01:17.202395 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:17.203268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:17.210776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:17.211265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:17.211710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:17.212398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:17.212865 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:17.213317 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:17.431568 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:17.439652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:17.441119 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:17.442294 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-58ff51ae-677b-486e-9594-24bee2dee943 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.244427 Sep 09 02:01:17.442849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 603/1164] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:17 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:18.468270 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:18.469416 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:18.471914 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:18.478083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:18.478583 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:18.479228 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:18.479932 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:18.480382 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:18.480798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:18.671170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:18.679795 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:18.681252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:18.682447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6ef16792-1f49-4576-b554-0fd1299de7f1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.218020 Sep 09 02:01:18.682975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 562/1165] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:18 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 02:01:19.709194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:19.710325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:19.716695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:19.717219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:19.717658 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:19.718353 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:19.718811 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:19.719236 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:19.858781 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:19.868081 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:19.870852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:19.872278 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b32f3efc-1876-46dc-8e95-710f1ef83bdd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.167031 Sep 09 02:01:19.872837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 604/1166] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:19 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:20.897737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:20.898346 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:20.905644 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:20.906402 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:20.906904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:20.907603 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:20.908233 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:20.908661 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:21.052923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:21.062701 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:21.064133 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:21.065389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-15d6b88c-fdec-44f2-9059-81b4e5c2b66d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1721 microversion: 2.20 time: 0.171656 Sep 09 02:01:21.065866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 563/1167] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:20 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 02:01:22.089705 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:22.090315 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:22.096769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:22.097288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:22.097722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:22.098405 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:22.098856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:22.099269 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:22.167565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:22.175660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:22.177113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:22.178266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5da00c0e-78b8-42ac-b767-7008c0e29184 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 200 len: 1654 microversion: 2.20 time: 0.092486 Sep 09 02:01:22.178872 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 605/1168] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:22 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 1654 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:22.347206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c66864-02f8-472d-9eaa-493d8b436cea", "name": "network-vif-deleted", "tag": "f88ba854-da0f-42a5-83ef-8989d5ee2753"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:22.361005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:22.361637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:22.362071 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:22.376847 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] Creating event network-vif-deleted:f88ba854-da0f-42a5-83ef-8989d5ee2753 for instance 86c66864-02f8-472d-9eaa-493d8b436cea on hv-cinder-85221 Sep 09 02:01:22.384151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-e30cd384-1267-42d8-b83f-406c8b14a9bb req-8ac55b90-523b-476b-9c28-6a32075df168 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040669 Sep 09 02:01:22.385328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 564/1169] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:01:23.203249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:23.203782 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:23.210900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:23.211388 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:23.211820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:23.212566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:23.213014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:23.213482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:23.227324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea HTTP/1.1 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:01:23.228999 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:01:23.230541 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '86c66864-02f8-472d-9eaa-493d8b436cea'} Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:01:23.231400 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:01:23.232893 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:01:23.234660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:01:23.234660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c018e40b-8d3f-4717-8440-c17913f27111 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 404 len: 111 microversion: 2.20 time: 0.031246 Sep 09 02:01:23.234660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 606/1170] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:23 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:01:23.240166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5d0ba5e5-c613-4924-83c5-b09473989ccb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '.version_select at 0x7f87d86cd1f0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:23.260737 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5d0ba5e5-c613-4924-83c5-b09473989ccb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196313835" status: 204 len: 0 microversion: 2.20 time: 0.024788 Sep 09 02:01:23.261354 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 565/1171] 10.222.0.15 () {60 vars in 1259 bytes} [Fri Sep 9 02:01:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196313835 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 02:01:23.889841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: .version_select at 0x7f87d8613700>, body: {"keypair": {"name": "tempest-keypair-107053731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIaoS0vpDTMy58roMQ81UwH60IcLSyLLdZ1hsIGThuKvqt/iOGtB7eQdTcmTr88Sj5dJGfB9ufRnQZVBBK6eOLayFIuIqq5ZM2RJ7nn93Uce8ha/zGDgcbHsB7WVEffPA=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:23.905776 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for project d2f935cd526946779ecce236c9d47f3f. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 02:01:23.909631 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for user eaaf03c8c05d4f598328ef5c05974e5e and project d2f935cd526946779ecce236c9d47f3f. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 02:01:23.921779 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [a9418a19-4571-4a3e-b1c0-8a2b22721547] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 02:01:24.929325 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [a9418a19-4571-4a3e-b1c0-8a2b22721547] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 44026. Sep 09 02:01:24.945145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e4a82336-ebf1-49db-83f6-4241fcd04256 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.059181 Sep 09 02:01:24.945725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 607/1172] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Sep 9 02:01:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1060 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 02:01:26.206921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-980657806", "imageRef": "5ec58165-6bd1-48bd-8c9d-a574d74f3969", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52c17b8d-9cbf-4b19-b734-8dfd42851345"}], "security_groups": [{"name": "tempest-securitygroup--102488163"}], "key_name": "tempest-keypair-107053731", "user_data": "}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:26.313098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] validate_networks() for [('52c17b8d-9cbf-4b19-b734-8dfd42851345', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 02:01:26.808670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 02:01:26.809123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 02:01:26.809598 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 02:01:26.810040 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 02:01:26.810448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 02:01:26.819724 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:26.820142 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:26.820571 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:26.821321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:26.821789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:26.822210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:26.839057 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for project d2f935cd526946779ecce236c9d47f3f. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 02:01:26.842990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Getting quotas for user eaaf03c8c05d4f598328ef5c05974e5e and project d2f935cd526946779ecce236c9d47f3f. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 02:01:26.853694 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 02:01:26.856059 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec58165-6bd1-48bd-8c9d-a574d74f3969',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 02:01:26.903800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7c331edf-1330-44bb-bea9-4dae06f07bbb tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.701660 Sep 09 02:01:26.904454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 566/1173] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Sep 9 02:01:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 02:01:26.916429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:26.917231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:26.971486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:26.978807 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:26.980421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:26.981760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-34d6e9e0-0865-4125-a494-0f37bd40f79c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1280 microversion: 2.20 time: 0.070114 Sep 09 02:01:26.982304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 608/1174] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:26 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:28.007374 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:28.008034 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:28.016589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:28.018920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:28.019419 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:28.020236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:28.020912 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:28.021556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:28.109940 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:28.123117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:28.124626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:28.125920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-838158aa-1bbc-49a6-92c1-b4520b8881ee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1350 microversion: 2.20 time: 0.123234 Sep 09 02:01:28.128053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 567/1175] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:28 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:29.153263 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:29.153877 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:29.160261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:29.160743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:29.161206 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:29.161888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:29.162339 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:29.163259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:29.410257 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:29.419296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:29.420805 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:29.422148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-63690c35-b944-4a56-bcf1-3d2162b4ef03 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.272750 Sep 09 02:01:29.437126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 609/1176] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:29 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:29.840738 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:29.851650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:29.852169 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:29.852593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:29.863304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] Creating event network-changed:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:01:29.868776 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-16b9c34d-a448-433e-b77a-221e7a38eed7 req-a48d8104-27e0-45dd-8d12-552cc4672ec2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031820 Sep 09 02:01:29.869774 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 568/1177] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:01:30.448848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:30.449503 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:30.455790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:30.456266 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:30.456693 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:30.457402 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:30.457851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:30.458264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:30.589894 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:30.597820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:30.599233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:30.600827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-45305bf0-0e7f-4906-a706-4d524f3061ed tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.155913 Sep 09 02:01:30.601415 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 610/1178] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:30 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:31.627360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:31.628063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:31.634206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:31.634692 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:31.635128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:31.635820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:31.636279 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:31.636706 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:31.763312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:31.771318 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:31.773298 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:31.774403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-73abd2c9-9fcc-4bdd-98b8-d62d79303fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.151885 Sep 09 02:01:31.774964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 569/1179] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:31 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:32.799556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:32.800167 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:32.806561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:32.807039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:32.807476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:32.808154 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:32.808607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:32.809026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:32.944427 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:32.952373 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:32.953988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:32.955158 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1ce6fd6b-602a-4e03-a830-81a57490bf73 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.159505 Sep 09 02:01:32.955635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 611/1180] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:32 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:33.979988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:33.980632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:33.986654 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:33.987138 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:33.987573 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:33.988265 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:33.988975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:33.989642 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:34.127357 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:34.136653 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:34.138096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:34.139203 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7de75b15-0371-429c-9d06-e335759e4dee tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.163334 Sep 09 02:01:34.139772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 570/1181] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:33 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:35.163794 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:35.164340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:35.170635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:35.171111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:35.171538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:35.172217 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:35.172664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:35.173101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:35.301356 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:35.310363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:35.312009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:35.313350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-86c8a0cc-04bd-40cc-8089-afdaa2fc53db tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.153358 Sep 09 02:01:35.332773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 612/1182] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:35 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:35.432320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "name": "network-vif-plugged", "status": "completed", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:35.450115 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:35.450771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:35.451256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:35.471053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] Creating event network-vif-plugged:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:01:35.477911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-b00767aa-599a-4b38-843c-fc66f63ae6f4 req-89d1c22d-0df6-413f-bc42-4712d0c959be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054235 Sep 09 02:01:35.478927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 571/1183] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:01:36.338835 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:36.339444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:36.345813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:36.346298 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:36.346736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:36.347422 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:36.347873 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:36.348292 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:36.472926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:36.481559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:36.483009 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:36.484111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-d69d3bc5-81e7-45ad-b561-f6064e71f8dc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.149207 Sep 09 02:01:36.484692 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 613/1184] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:36 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:37.507879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:37.508643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:37.512979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:37.513714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:37.520628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:37.521143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:37.521580 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:37.522271 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:37.522723 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:37.523811 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:37.654463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:37.662978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:37.664410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:37.665539 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-aebde184-78ab-495b-bcfe-894a497d8935 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.159629 Sep 09 02:01:37.666085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 572/1185] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:37 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:38.691517 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:38.801624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:38.802265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:38.808802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:38.809319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:38.809754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:38.810438 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:38.810888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:38.811312 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:38.939816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:38.947885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:38.949297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:38.950399 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b1fb9f34-a388-45ac-b054-b8ab4f84bd39 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.263546 Sep 09 02:01:38.950946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 614/1186] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:38 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:39.974828 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:39.975373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:39.981838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:39.982320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:39.982754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:39.983443 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:39.983896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:39.984316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:40.111136 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:40.120014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:40.121473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:40.122572 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-de72fb22-7220-483d-8634-11255403754f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.151730 Sep 09 02:01:40.123128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 573/1187] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:39 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:41.148424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:41.149033 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:41.155621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:41.156125 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:41.156564 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:41.157288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:41.157750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:41.158173 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:41.233998 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 02:01:41.234243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Fri Sep 9 02:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 (ip 10.222.0.15) !!! Sep 09 02:01:41.290386 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:41.298559 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:41.300030 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:41.301183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-daa42ff0-6a52-4f1d-9577-837158ea2d89 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.157274 Sep 09 02:01:41.301745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 615/1188] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:41 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:42.326285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:42.326881 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:42.333256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:42.333733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:42.334160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:42.334835 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:42.335302 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:42.335719 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:42.338214 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:42.467373 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:42.475376 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:42.477326 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:42.478454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-eeb52fb3-81b9-402d-9f27-c74a6ab4afbd tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.156038 Sep 09 02:01:42.479010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 574/1189] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:42 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:43.504342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:43.504951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:43.511406 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:43.511884 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:43.512319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:43.513010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:43.513489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:43.513910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:43.644898 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:43.653394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:43.654818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:43.655915 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e0ea22b7-7e6f-4ee0-971f-80f36ffdbe6a tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.155521 Sep 09 02:01:43.656475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 616/1190] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:43 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:44.681236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:44.681866 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:44.688150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:44.688626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:44.689052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:44.689756 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:44.690199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:44.690613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:44.835793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:44.843686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:44.845128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:44.846214 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-29b4b453-13ce-497f-8fdb-7369722a6460 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1405 microversion: 2.20 time: 0.169351 Sep 09 02:01:44.846810 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 575/1191] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:44 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:45.871874 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:45.872477 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:45.874831 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:45.880605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:45.881113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:45.881558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:45.882850 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:45.883321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:45.883748 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:45.888357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:01:46.015045 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:46.023132 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:46.024563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:01:46.025745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-95ffd62f-0b87-4d71-b713-4867a08694be tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1596 microversion: 2.20 time: 0.157780 Sep 09 02:01:46.026297 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 617/1192] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:01:45 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1596 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:01:46.049762 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:01:46.050285 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:01:46.057190 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:46.057677 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:46.058111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:46.058800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:46.059252 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:46.059675 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:46.135340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-cafa2f98-e733-49ee-92bf-4232782eeaa9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089417 Sep 09 02:01:46.135935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 576/1193] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Sep 9 02:01:46 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 02:01:47.095789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:01:47.106565 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:01:47.107038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:01:47.107458 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:01:47.119048 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] Creating event network-changed:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:01:47.123989 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-e3007b4d-6640-46dc-9b24-072fa8d5b4d8 req-4a173d6a-82a2-49be-8688-e1a2cadd3f66 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Sep 09 02:01:47.124561 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 618/1194] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:03:02.194098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:02.194758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=15 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:02.199063 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:02.199546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:02.206796 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:02.207272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:02.208307 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:02.208990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:02.209464 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:02.209880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:02.232767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1c04fa0e-5fc2-4810-a988-57d4b737ab85 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/ips" status: 200 len: 151 microversion: 2.20 time: 0.041286 Sep 09 02:03:02.233352 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 577/1195] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Sep 9 02:03:02 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 02:03:04.036111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=3 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:04.036856 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=7 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:04.041673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:04.042333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:04.049140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:04.049632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:04.050071 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:04.050760 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:04.051219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:04.052148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:04.074840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.objects.instance [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lazy-loading 'flavor' on Instance uuid e23ed158-51de-482c-a548-98a49786d083 {{(pid=126895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:03:04.262421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a917bf52-e3c3-4e93-ab35-c51f2d7d7650 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/action" status: 202 len: 0 microversion: 2.20 time: 0.228148 Sep 09 02:03:04.263014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 619/1196] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 02:03:04 2022] POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:03:04.271227 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:04.271895 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:04.278381 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:04.278859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:04.279288 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:04.280018 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:04.280520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:04.280889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:04.411554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:04.419490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:04.420906 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:04.422076 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0de4969a-787b-4087-a4e0-7db8138a6e11 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.154772 Sep 09 02:03:04.422634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 578/1197] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:04 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:05.448301 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:05.448996 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:05.455833 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:05.456304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:05.456730 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:05.457937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:05.458394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:05.458809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:05.598951 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:05.607003 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:05.608429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:05.609622 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ff50db95-71e3-446c-bf16-10f9e49a3bae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.166057 Sep 09 02:03:05.610182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 620/1198] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:05 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:06.633911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:06.634513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:06.641001 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:06.641505 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:06.641935 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:06.642616 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:06.643068 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:06.643487 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:06.768954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:06.776896 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:06.778345 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:06.779502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a9b5d59c-61cd-4ad2-94f5-65b5a1edb6b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.149496 Sep 09 02:03:06.780070 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 579/1199] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:06 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:07.805361 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:07.806006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:07.812246 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:07.812723 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:07.813179 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:07.813864 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:07.814310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:07.814721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:07.950643 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:07.958687 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:07.960111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:07.961285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-34c310f9-72bd-4f24-86cb-fa85de867362 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.160608 Sep 09 02:03:07.961838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 621/1200] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:07 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:08.986838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:08.987697 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:08.994150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:08.994632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:08.995067 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:08.995751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:08.996206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:08.996632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:09.121700 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:09.130162 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:09.131596 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:09.132739 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b95c3ebf-1e86-41a4-9f66-0b173fd64afa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.149858 Sep 09 02:03:09.133340 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 580/1201] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:08 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:10.157739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:10.158293 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:10.164609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:10.165108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:10.165544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:10.166220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:10.166676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:10.167094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:10.295034 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:10.303609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:10.305038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:10.306214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fa5cdb98-9844-4af0-8e40-f4bad6dfb025 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.152602 Sep 09 02:03:10.306775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 622/1202] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:10 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:11.330838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:11.331444 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:11.338426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:11.338902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:11.339330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:11.340016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:11.340490 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:11.340905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:11.470411 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:11.478353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:11.479768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:11.480904 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2e1ee4e4-319a-4a71-a3b8-5211fd305115 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.153939 Sep 09 02:03:11.481492 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 581/1203] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:11 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:12.507176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:12.507819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:12.514182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:12.514669 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:12.515103 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:12.515790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:12.516239 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:12.516657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:12.645702 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:12.653626 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:12.655047 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:12.656197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5accb52b-8732-48ae-998d-e5a8b77954c8 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.153535 Sep 09 02:03:12.656754 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 623/1204] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:12 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:13.682224 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:13.682823 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:13.689277 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:13.689755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:13.690183 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:13.690864 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:13.691312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:13.692330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:13.821299 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:13.829130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:13.830544 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:13.831688 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d6e9ebee-4116-4773-a8c0-6ad8dd533d07 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.153350 Sep 09 02:03:13.832747 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 582/1205] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:13 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:14.859070 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:14.859675 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:14.866830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:14.867302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:14.867729 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:14.868403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:14.868848 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:14.869291 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:14.994784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:15.002657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:15.004078 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:15.005268 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-61279d0d-c0c2-478c-9476-57cc60250f96 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.150036 Sep 09 02:03:15.005819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 624/1206] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:14 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:16.030207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:16.030805 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:16.037731 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:16.038207 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:16.038632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:16.039309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:16.039754 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:16.040170 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:16.168634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:16.176660 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:16.178098 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:16.179242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-83ce2408-b92f-4d32-ab4c-dbabf4a054af tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1742 microversion: 2.20 time: 0.152897 Sep 09 02:03:16.179794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 583/1207] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:16 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:17.205041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:17.205613 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:17.212450 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:17.212925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:17.213507 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:17.214191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:17.214639 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:17.215057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:17.343736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:17.351758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:17.353224 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:17.354385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ba99ce3e-60d9-41a7-b2ee-1a8b7601d090 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1742 microversion: 2.20 time: 0.153336 Sep 09 02:03:17.354947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 625/1208] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:17 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:18.379931 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:18.380523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:18.388691 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:18.389403 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:18.390123 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:18.391255 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:18.391889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:18.392363 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:18.522036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:18.529975 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:18.531406 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:18.532555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-512f78c6-8d21-417d-b08c-d642c1ee2fc7 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1742 microversion: 2.20 time: 0.156638 Sep 09 02:03:18.533121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 584/1209] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:18 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:19.557154 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:19.557766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:19.564113 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:19.564589 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:19.565021 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:19.565724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:19.566718 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:19.567145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:19.698790 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:19.706829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:19.708264 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:19.709447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a28aa7fa-d87b-4091-a7df-ccbdfa21e60f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1742 microversion: 2.20 time: 0.156149 Sep 09 02:03:19.710004 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 626/1210] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:19 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:20.001519 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "name": "network-vif-plugged", "status": "completed", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:20.011216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:20.011690 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:20.012116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:20.023304 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] Creating event network-vif-plugged:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:03:20.028186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-d249d562-8851-4c4f-b545-1d89abe7301f req-89a77919-9e7e-4139-9848-a85ca6a48fae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Sep 09 02:03:20.028780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 585/1211] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:03:20.734347 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:20.734949 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:20.742146 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:20.742849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:20.743506 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:20.744392 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:20.745006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:20.745644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:20.883220 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:20.891929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:20.893650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:20.895080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6cc56bb3-6b33-4ebb-8b0d-57d05bee3835 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.164525 Sep 09 02:03:20.895726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 627/1212] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:20 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:21.925124 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:21.926401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:21.933284 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:21.933798 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:21.934247 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:21.934991 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:21.935445 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:21.935898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:22.086120 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:22.095643 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:22.097387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:22.098664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-609bb537-6fe1-4fe3-a53c-7188153882ae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.178143 Sep 09 02:03:22.099491 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 586/1213] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:21 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:23.131371 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:23.132029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:23.140172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:23.140690 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:23.141108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:23.141812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:23.142271 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:23.142692 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:23.289014 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:23.297538 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:23.298979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:23.300140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-86b07de9-688d-4d73-b7ba-6cb85d3c1bb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.173838 Sep 09 02:03:23.300755 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 628/1214] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:23 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:24.333424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:24.335576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:24.342986 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:24.343486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:24.343909 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:24.344608 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:24.345084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:24.345506 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:24.502659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:24.511759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:24.513313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:24.514882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5c28d504-cfa0-4725-b72f-418f9a9e55a1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.190088 Sep 09 02:03:24.516008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 587/1215] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:24 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:25.541211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:25.541808 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:25.548556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:25.549323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:25.549637 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:25.550342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:25.550800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:25.551256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:25.704241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:25.716888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:25.718366 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:25.720160 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a741ada0-22a5-46e2-acb5-7218cfc5ddfc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.182947 Sep 09 02:03:25.721038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 629/1216] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:25 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:26.746327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:26.747631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:26.755663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:26.756175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:26.756612 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:26.757367 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:26.757815 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:26.758450 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:27.099712 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:27.114186 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:27.115784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:27.117042 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff9fb385-a435-414c-97c5-f004e65b482b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.374641 Sep 09 02:03:27.117767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 588/1217] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:26 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:28.143478 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:28.144840 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:28.151241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:28.151742 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:28.152252 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:28.153020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:28.153566 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:28.154233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:28.376612 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:28.385644 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:28.387172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:28.388689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-fd5e147a-7003-4df2-b642-53673e596255 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.249073 Sep 09 02:03:28.389046 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 630/1218] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:28 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:29.416751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:29.417389 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:29.423674 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:29.424149 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:29.424575 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:29.425905 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:29.426351 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:29.426766 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:29.551456 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:29.559384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:29.560801 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:29.561964 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-68e93c5a-4a87-44b0-ae0e-aa60865be747 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1737 microversion: 2.20 time: 0.149101 Sep 09 02:03:29.562516 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 589/1219] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:29 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:30.586211 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:30.586867 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:30.593221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:30.593706 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:30.594140 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:30.594837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:30.595288 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:30.595711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:30.822967 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:30.830786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:30.832786 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:30.833970 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c4f1ae54-b7cc-4be0-b64e-4f6f500c2091 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1719 microversion: 2.20 time: 0.252341 Sep 09 02:03:30.834728 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 631/1220] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:30 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1719 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:31.858546 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:31.859155 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:31.865921 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:31.866400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:31.866836 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:31.867520 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:31.868056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:31.868480 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:31.995707 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:32.004199 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:32.005728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:32.006882 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-1eeb2ca6-132f-4d26-8399-e3faabe30bea tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1719 microversion: 2.20 time: 0.152282 Sep 09 02:03:32.007448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 590/1221] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:31 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:33.031581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:33.032194 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:33.038640 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.039128 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.039569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.040258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.040716 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.041171 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.164820 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:33.172812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:33.174287 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:33.175946 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-68e028bc-8082-4c73-bd00-9f157c8f3cb4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1662 microversion: 2.20 time: 0.148319 Sep 09 02:03:33.176501 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 632/1222] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:33 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:33.201319 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e4f95dc-7c07-43ae-b69c-dbc2e4542e03"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:33.203678 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:33.206150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=29 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:33.211299 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.211779 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.212210 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.212897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.213380 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.213800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.217531 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=79 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:33.474713 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5a910f86-b94b-457a-9754-4f5e692744ac tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277268 Sep 09 02:03:33.475327 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 591/1223] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Sep 9 02:03:33 2022] POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 02:03:33.598430 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:33.598930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:33.604775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.605304 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.605746 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.606439 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.606897 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.607321 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.626600 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:33.851887 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ac9f13b2-6234-4650-8266-87ada195e848 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments/5e4f95dc-7c07-43ae-b69c-dbc2e4542e03" status: 202 len: 0 microversion: 2.20 time: 0.257778 Sep 09 02:03:33.852498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 633/1224] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Sep 9 02:03:33 2022] DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments/5e4f95dc-7c07-43ae-b69c-dbc2e4542e03 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:03:33.913672 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:33.914264 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:33.920751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.921274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.921709 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.922397 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:33.922850 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:33.923267 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:33.952062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126896) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 02:03:34.024375 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-add81231-ca56-4b39-a8e3-61223cbc9ef2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/action" status: 202 len: 0 microversion: 2.20 time: 0.114867 Sep 09 02:03:34.025273 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 592/1225] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Sep 9 02:03:33 2022] POST /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 02:03:34.033514 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:34.035391 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:34.041824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "name": "network-vif-unplugged", "status": "completed", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:34.047724 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=31 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:03:34.049958 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:34.050900 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:34.051824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:34.053259 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:34.053918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:34.054535 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:34.056241 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:34.056782 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:34.057296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:34.071037 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.compute.server_external_events [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] Unable to find a host for instance e23ed158-51de-482c-a548-98a49786d083. Dropping event network-vif-unplugged {{(pid=126896) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 02:03:34.072000 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-0a98f3c5-8335-4b94-a4a5-058e556359d8 req-bc0bf18e-eb85-408b-a00d-5c29f822f1ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035208 Sep 09 02:03:34.072985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 593/1226] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 02:03:34.196285 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:34.205111 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:34.207131 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:34.208436 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a0ea929a-71e5-48af-8faf-c1c494ecc1d1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1670 microversion: 2.20 time: 0.178775 Sep 09 02:03:34.208981 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 634/1227] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:34 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 02:03:35.233384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:35.233984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:35.241240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:35.241718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:35.242145 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:35.242824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:35.243269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:35.243681 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:35.444541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:35.452634 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:35.454093 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:35.455250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-febc0ba2-7925-418a-ac87-15f5e019bfe4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.225812 Sep 09 02:03:35.455814 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 594/1228] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:35 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:36.481994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:36.482757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:36.490813 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:36.491299 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:36.491737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:36.492483 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:36.492938 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:36.493397 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:36.646059 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:36.654233 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:36.655651 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:36.657035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-60fafdde-f30c-4758-b964-9a67c286d67e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.178893 Sep 09 02:03:36.657543 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 635/1229] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:36 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:37.683320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:37.683852 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:37.691221 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:37.691742 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:37.697426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:37.698343 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:37.698908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:37.699452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:37.841372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:37.850164 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:37.851606 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:37.852917 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-edaeb967-41d3-4763-be2b-616e34fdb9f0 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.173458 Sep 09 02:03:37.853721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 595/1230] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:37 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:38.879533 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:38.881231 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:38.888558 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:38.889382 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:38.890006 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:38.891295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:38.895635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:38.895635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:39.035135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:39.043367 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:39.044780 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:39.045963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-18ebc25f-ede9-41af-886b-c66b001fa515 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.170786 Sep 09 02:03:39.046516 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 636/1231] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:38 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:40.070934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:40.071534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:40.078248 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:40.078803 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:40.079309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:40.080016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:40.080483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:40.081599 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:40.219460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:40.228321 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:40.229771 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:40.230926 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d67740c0-2845-4c27-9c5a-8eb6e06502fa tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.163895 Sep 09 02:03:40.231663 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 596/1232] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:40 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:41.258802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:41.260605 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:41.267343 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:41.267896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:41.268950 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:41.269673 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:41.270204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:41.270621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:41.410204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:41.418695 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:41.420183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:41.421393 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b454d551-e842-4004-a8c4-33da99761064 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.167252 Sep 09 02:03:41.421966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 637/1233] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:41 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:42.450272 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:42.451933 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:42.461908 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:42.462454 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:42.462984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:42.463755 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:42.464293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:42.464788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:42.599772 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:42.608705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:42.610589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:42.611847 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-7e18563e-62df-40a7-a2e4-99baa530bd83 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.167693 Sep 09 02:03:42.614151 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 597/1234] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:42 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:43.654310 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:43.654914 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:43.662977 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:43.663725 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:43.664247 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:43.665031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:43.665634 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:43.666145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:43.806200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:43.814314 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:43.816597 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:43.817892 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8b64d51d-04df-4ada-837e-8ecc9d178c62 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.169190 Sep 09 02:03:43.818732 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 638/1235] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:43 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:44.842978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:44.843992 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:44.850605 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:44.851082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:44.851506 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:44.852184 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:44.852626 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:44.853038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:44.979911 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:44.988470 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:44.989925 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:44.991068 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-ff7624c1-ad2a-4635-b739-9d509aa36d05 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.151974 Sep 09 02:03:44.991632 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 598/1236] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:44 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:46.016241 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:46.017040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:46.024191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:46.024676 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:46.025145 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:46.025833 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:46.026283 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:46.026704 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:46.152751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:46.160682 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:46.162142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:46.163333 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-a224f583-5cc4-4e33-bce4-03b2e7a11b2e tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.151250 Sep 09 02:03:46.163927 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 639/1237] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:46 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:47.188982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:47.189567 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:47.196025 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:47.196498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:47.196924 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:47.197631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:47.198075 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:47.198486 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:47.325703 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:47.334259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:47.335734 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:47.336883 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-842d520e-1dfb-4336-93a9-4c8e4b3372b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.151814 Sep 09 02:03:47.337473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 599/1238] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:47 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:48.364191 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:48.364920 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:48.387342 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:48.388212 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:48.389287 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:48.392476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:48.392476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:48.392476 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:48.530184 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:48.538739 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:48.540204 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:48.541411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e5106692-a5e6-45fe-8407-efac35211cbc tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.182312 Sep 09 02:03:48.542175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 640/1239] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:48 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:49.567566 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:49.568201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:49.574078 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:49.574555 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:49.574985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:49.575668 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:49.576117 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:49.576535 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:49.804504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:49.812468 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:49.813920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:49.815680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-58b878d0-93e3-44c5-a77d-b3901f195825 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.252020 Sep 09 02:03:49.816238 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 600/1240] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:49 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:50.841502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:50.842099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:50.848363 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:50.848839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:50.849309 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:50.849988 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:50.850433 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:50.850849 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:50.976851 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:50.984791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:50.986243 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:50.987681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8486873a-99de-486c-a151-f71a5e40d24d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.150053 Sep 09 02:03:50.988229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 641/1241] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:50 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:52.013513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:52.014211 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:52.021960 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:52.022460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:52.022877 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:52.023577 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:52.024030 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:52.024446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:52.084084 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "name": "network-vif-plugged", "status": "completed", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:03:52.103844 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:52.104662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:52.105175 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:52.118176 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] Creating event network-vif-plugged:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:03:52.123636 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-fb2b35d4-17c2-40af-88ce-c07df970cdf8 req-96633319-f124-436f-a617-2d3cd210c5b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043689 Sep 09 02:03:52.124469 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 642/1242] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:03:52.163588 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:52.171897 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:52.173365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:52.174534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-560ee4b3-812b-494d-be4d-2b0afe731c4f tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.164906 Sep 09 02:03:52.175096 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 601/1243] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:52 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:53.200792 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:53.201530 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:53.207787 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:53.208276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:53.208714 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:53.209435 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:53.209896 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:53.210323 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:53.340355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:53.350429 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:53.352270 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:53.354082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-7237a19a-527f-47a0-850e-593fe7933c1d tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.157701 Sep 09 02:03:53.354806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 643/1244] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:53 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:54.380015 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:54.380716 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:54.387330 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:54.387817 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:54.388257 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:54.388951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:54.389447 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:54.389869 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:54.528969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:54.538081 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:54.539502 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:54.540650 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9e95315d-aab8-444f-9f21-191d5ae6d2a4 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1728 microversion: 2.20 time: 0.165184 Sep 09 02:03:54.541232 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 602/1245] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:54 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:03:55.566664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:03:55.566664 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:03:55.573148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:55.573531 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:55.574010 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:55.574632 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:03:55.575080 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:03:55.575498 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:03:55.699394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:55.707880 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:55.709335 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:03:55.710486 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-34e6aef8-bb3d-4f23-91db-8452bcb4fdae tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1715 microversion: 2.20 time: 0.148380 Sep 09 02:03:55.711036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 644/1246] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:03:55 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:04:51.049365 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:51.051751 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:51.055127 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:04:51.056052 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:04:51.060147 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.060740 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.061222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.061983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.062503 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.062955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.095856 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9b072382-fab6-4ef6-80f8-e5d062bef389 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050869 Sep 09 02:04:51.096421 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 603/1247] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Sep 9 02:04:51 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:04:51.160906 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:51.161506 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:51.163797 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=21 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:04:51.164629 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:04:51.172357 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.173404 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.173841 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.174544 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.175609 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.176041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.202798 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Going to try to terminate instance {{(pid=126895) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:04:51.282857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c3e07e5e-653c-4bfe-9e2f-49dd5b97789c tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 204 len: 0 microversion: 2.20 time: 0.125601 Sep 09 02:04:51.283757 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 645/1248] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 02:04:51 2022] DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 02:04:51.291784 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:51.292424 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:51.298880 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.299372 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.299802 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.300484 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:51.300934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:51.301387 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:51.430161 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:51.438821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:51.440275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:51.441462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-16efe79f-5c4d-4800-b6a6-19853e51e8b3 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.153509 Sep 09 02:04:51.442024 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 604/1249] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:51 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:04:52.467418 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:52.468109 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:52.475057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:52.475555 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:52.475972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:52.476659 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:52.477133 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:52.477552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:52.679032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:52.687302 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:52.689468 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:52.691227 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2009dd49-5b64-48dd-b1da-d34f9099a4b5 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.228090 Sep 09 02:04:52.691819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 646/1250] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:52 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:04:53.717889 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:53.718442 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:53.726240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:53.726240 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:53.726693 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:53.727446 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:53.727907 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:53.728328 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:53.959775 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:53.967982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:53.970116 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:53.971031 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a24fc509-24a5-4e55-b527-8e115186cf67 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1721 microversion: 2.20 time: 0.257061 Sep 09 02:04:53.971593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 605/1251] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:53 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:04:54.408773 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23ed158-51de-482c-a548-98a49786d083", "name": "network-vif-deleted", "tag": "c92a3dca-6ffc-4e13-bd24-efc29c8deebb"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:04:54.421142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:54.423221 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:54.423663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:54.436921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] Creating event network-vif-deleted:c92a3dca-6ffc-4e13-bd24-efc29c8deebb for instance e23ed158-51de-482c-a548-98a49786d083 on hv-cinder-85221 Sep 09 02:04:54.442966 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-7df1f6e8-6f17-47dc-89f6-0725c71ef495 req-908621ad-0ed7-4ffa-9560-6235a888b396 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038365 Sep 09 02:04:54.444114 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 647/1252] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:04:54.997638 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:54.998398 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:55.006202 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:55.006990 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:55.007432 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:55.008150 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:55.008607 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:55.009021 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:55.057310 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:55.058014 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:55.058460 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:55.058901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lazy-loading 'fault' on Instance uuid e23ed158-51de-482c-a548-98a49786d083 {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:04:55.105320 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:55.113560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:55.115048 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaaf03c8c05d4f598328ef5c05974e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f935cd526946779ecce236c9d47f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:04:55.116216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-256add97-53e0-475c-bc0f-9364647f42b9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 200 len: 1370 microversion: 2.20 time: 0.123409 Sep 09 02:04:55.117016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 606/1253] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:54 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 1370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 02:04:56.140683 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:56.141910 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:56.148454 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:56.148942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:56.149403 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:56.150098 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:56.150554 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:56.150982 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:56.164026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 HTTP/1.1 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:04:56.165686 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:56.167529 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'e23ed158-51de-482c-a548-98a49786d083'} Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:04:56.168617 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:56.170378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:56.171984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:04:56.171984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-87cc78a2-db90-4e85-a684-3885c0cc165b tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 404 len: 111 microversion: 2.20 time: 0.030755 Sep 09 02:04:56.171984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 648/1254] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:56 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:04:56.176613 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-41e85596-8e4c-496b-9113-c7b11c74ffe1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '.version_select at 0x7f87d88a9af0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:56.195829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-41e85596-8e4c-496b-9113-c7b11c74ffe1 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107053731" status: 204 len: 0 microversion: 2.20 time: 0.022970 Sep 09 02:04:56.196400 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 607/1255] 10.222.0.15 () {60 vars in 1259 bytes} [Fri Sep 9 02:04:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107053731 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 02:04:57.943758 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:57.944279 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:57.950679 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:57.951157 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:57.951594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:57.952283 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:57.952734 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:57.953258 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:57.966225 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 HTTP/1.1 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:04:57.967756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:57.969654 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'e23ed158-51de-482c-a548-98a49786d083'} Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:04:57.970834 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:57.972553 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:57.974197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:04:57.974197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-3977ec67-144a-4826-8ebd-c6e1e49c4ee2 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 404 len: 111 microversion: 2.20 time: 0.029282 Sep 09 02:04:57.974197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 649/1256] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 02:04:57 2022] DELETE /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:04:57.978097 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:57.978710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: e23ed158-51de-482c-a548-98a49786d083] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:57.985728 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:57.986462 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:57.986898 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:57.987590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:57.988049 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:57.988473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:58.001886 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 HTTP/1.1 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:04:58.003514 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:58.005600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': 'e23ed158-51de-482c-a548-98a49786d083'} Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:04:58.006783 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. Sep 09 02:04:58.008581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:58.010111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance e23ed158-51de-482c-a548-98a49786d083 could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:04:58.010111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-67df1118-480b-4524-86f3-fdf8ab173b88 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083" status: 404 len: 111 microversion: 2.20 time: 0.031254 Sep 09 02:04:58.010111 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 608/1257] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:57 2022] GET /compute/v2.1/servers/e23ed158-51de-482c-a548-98a49786d083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:04:59.140580 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:59.141163 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:59.147489 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:59.147913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:59.148344 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:59.149029 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:59.149504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:59.149925 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:59.163378 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea HTTP/1.1 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:04:59.164962 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.166722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': '86c66864-02f8-472d-9eaa-493d8b436cea'} Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:04:59.167657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.169249 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.170943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:04:59.170943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-91c5b682-81d1-48a1-9581-24b994a59c54 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 404 len: 111 microversion: 2.20 time: 0.029646 Sep 09 02:04:59.170943 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 650/1258] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Sep 9 02:04:59 2022] DELETE /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:04:59.175225 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:04:59.175837 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] [instance: 86c66864-02f8-472d-9eaa-493d8b436cea] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:04:59.182868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:59.183347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:59.183781 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:59.184473 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:04:59.184927 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:04:59.185430 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:04:59.198620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.wsgi [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] HTTP exception thrown: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Request method failure captured: Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: request: GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea HTTP/1.1 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept: application/json Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Accept-Encoding: identity Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Connection: close Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Length: 0 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Content-Type: application/json Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Host: 10.222.0.15 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: Openstack-System-Scope: None Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: User-Agent: python-urllib3/1.26.12 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Auth-Token: gAAAAABjGp1VaNmwOlHCOUK6WbvflTDytp1IF96uavb02XKsml38L7Sf3l3jnNL453HaPOC1UFYwnACi20m3hdD9gkBz-tYsX6DuiYWRWW2B8Q3S9GJh59FPNOnosAX_MmaOsP9kaHYhjx6LGFmbT9M_NlB_pJ1jdZTAfPIHq56PeQy2lZI1KyU Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Id: None Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Domain-Name: None Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Identity-Status: Confirmed Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Is-Admin-Project: True Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Id: default Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Domain-Name: Default Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Role: reader,member Sep 09 02:04:59.200166 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Roles: reader,member Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d2f935cd526946779ecce236c9d47f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d2f935cd526946779ecce236c9d47f3f", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Id: d2f935cd526946779ecce236c9d47f3f Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269072731 Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Id: default Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Domain-Name: Default Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Id: eaaf03c8c05d4f598328ef5c05974e5e Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269072731-project Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: method: > Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: exception: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.202039 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: action_args: {'id': '86c66864-02f8-472d-9eaa-493d8b436cea'} Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:04:59.203016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. Sep 09 02:04:59.204759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR nova.api.openstack.wsgi Sep 09 02:04:59.206219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] Returning 404 to user: Instance 86c66864-02f8-472d-9eaa-493d8b436cea could not be found. {{(pid=126896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:04:59.206219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-6ccc6144-c74f-4b58-9c54-4fe63e5f41d9 tempest-AttachVolumeShelveTestJSON-269072731 tempest-AttachVolumeShelveTestJSON-269072731-project] 10.222.0.15 "GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea" status: 404 len: 111 microversion: 2.20 time: 0.030798 Sep 09 02:04:59.206219 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 609/1259] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Sep 9 02:04:59 2022] GET /compute/v2.1/servers/86c66864-02f8-472d-9eaa-493d8b436cea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 02:06:07.881536 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 02:06:07.882099 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Fri Sep 9 02:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.15) !!! Sep 09 02:06:07.882711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 02:06:07.882839 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Fri Sep 9 02:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.15) !!! Sep 09 02:06:07.883628 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:07.884532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:07.888751 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-1ef653f5-ff5f-4c88-99ea-5b83251e5d14 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'create', calling method: .version_select at 0x7f87d86508b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1869241803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRYpIPRQk4OCEKQYRfAcmPXjQTkt1Kudw+jhFgKNoga1j9mOeDeQm9pfnKy5SPtkeAV2tngTvRf38JiLKIHY+r8iWqwcHhZMXzqONjslK/L8frfT5msAXKTwZmzZoG0ug=="}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:07.912148 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-1ef653f5-ff5f-4c88-99ea-5b83251e5d14 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Getting quotas for project eab48d377890454abfabbfa3053eaa57. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 02:06:07.915934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.quota [None req-1ef653f5-ff5f-4c88-99ea-5b83251e5d14 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Getting quotas for user 4d5be7be998f438d8ecb854412d7dbf5 and project eab48d377890454abfabbfa3053eaa57. Resources: {'key_pairs'} {{(pid=126895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 02:06:07.941735 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-1ef653f5-ff5f-4c88-99ea-5b83251e5d14 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062718 Sep 09 02:06:07.942349 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 651/1260] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Sep 9 02:06:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:07.990223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:07.990984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=30 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:07.995072 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-349427096", "imageRef": "3f008229-7ea8-428b-b782-6ea41370371a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1869241803", "networks": [{"uuid": "89d32ad8-d4eb-4f0d-9f7e-5f761ad129ca"}]}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:08.046951 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.network.neutron [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] validate_networks() for [('89d32ad8-d4eb-4f0d-9f7e-5f761ad129ca', None, None, None, None, None)] {{(pid=126896) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 02:06:08.414675 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Flavor limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 02:06:08.415251 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Image limits 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 02:06:08.415788 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Flavor pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 02:06:08.416312 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Image pref 0:0:0 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 02:06:08.417011 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.virt.hardware [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 02:06:08.430356 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:08.430988 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:08.431593 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:08.432659 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:08.433550 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:08.434243 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:08.459860 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Getting quotas for project eab48d377890454abfabbfa3053eaa57. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 02:06:08.465997 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.quota [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Getting quotas for user 4d5be7be998f438d8ecb854412d7dbf5 and project eab48d377890454abfabbfa3053eaa57. Resources: {'cores', 'instances', 'ram'} {{(pid=126896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 02:06:08.486581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Going to run 1 instances... {{(pid=126896) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 02:06:08.489865 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f008229-7ea8-428b-b782-6ea41370371a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 02:06:08.535244 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [e2c3e108-2f7f-4773-aff8-9f4286efeae3] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 02:06:09.543160 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [e2c3e108-2f7f-4773-aff8-9f4286efeae3] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 45732. Sep 09 02:06:09.546934 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-bf055ea3-a107-449f-9430-c0e62a7af075 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.558410 Sep 09 02:06:09.547624 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 610/1261] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Sep 9 02:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 02:06:09.559049 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-32987ac5-c9bc-49f0-8817-f2d09c0e0a29 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:09.559660 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-32987ac5-c9bc-49f0-8817-f2d09c0e0a29 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:09.614487 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-32987ac5-c9bc-49f0-8817-f2d09c0e0a29 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:09.621398 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-32987ac5-c9bc-49f0-8817-f2d09c0e0a29 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1258 microversion: 2.1 time: 0.066806 Sep 09 02:06:09.621964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 652/1262] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:09 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:06:10.645568 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:10.646181 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:10.652135 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:10.652620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:10.653053 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:10.653789 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:10.654242 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:10.654667 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:10.719662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:10.727558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-a9ea81b8-8498-432f-b31b-7e0b6f16f44a tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1310 microversion: 2.1 time: 0.086893 Sep 09 02:06:10.727939 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 611/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:10 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:11.751990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:11.752691 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:11.764905 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:11.765681 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:11.766303 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:11.767182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:11.767812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:11.768394 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:11.932126 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:11.941504 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-726ee490-0a0f-463b-a78b-d69d59c8f85d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.195359 Sep 09 02:06:11.944986 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 653/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:11 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:12.966591 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:12.967526 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:12.974867 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:12.975554 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:12.976347 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:12.977223 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:12.977838 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:12.978263 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:13.125276 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:13.133409 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2e5f0444-811c-4019-9c74-8c623191b8d5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.171162 Sep 09 02:06:13.133983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 612/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:12 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:14.157182 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:14.157745 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:14.163902 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:14.164390 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:14.164823 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:14.165578 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:14.166036 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:14.166460 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:14.307444 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:14.315942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5d98e2e9-7232-4073-b2c1-e39f0e9b6db4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.162832 Sep 09 02:06:14.316515 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 654/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:14 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:06:15.340820 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:15.341489 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:15.348335 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:15.348918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:15.349465 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:15.350239 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:15.350765 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:15.351256 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:15.495360 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:15.504038 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-26e016b0-2442-44b8-a910-1df9afca5a0f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.167246 Sep 09 02:06:15.505113 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 613/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:15 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:16.527383 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:16.528152 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:16.535374 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:16.535876 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:16.536316 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:16.537023 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:16.537508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:16.537934 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:16.681913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:16.690744 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ccab393e-6cfc-4f3e-bd0f-153b76187dd4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.167466 Sep 09 02:06:16.691322 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 655/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:16 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:17.717504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:17.718325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:17.725130 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:17.725702 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:17.726209 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:17.726979 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:17.727504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:17.728016 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:17.867071 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:17.875342 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-00d312cd-14b3-4326-87d8-c697dd1d9e1c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.164650 Sep 09 02:06:17.875901 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 614/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:17 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:18.898963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:18.899401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:18.906121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:18.906598 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:18.907024 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:18.907766 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:18.908210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:18.908624 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:19.046447 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:19.054093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-90c0566a-01dd-4177-b417-0ad6c117028d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.159640 Sep 09 02:06:19.054648 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 656/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:18 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:20.077010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:20.077640 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:20.079463 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:20.080177 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=6 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:20.086832 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:20.087305 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:20.087733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:20.088411 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:20.088857 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:20.089303 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:20.214768 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:20.222217 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-73abeafc-0094-4706-a0f9-62544e57ed80 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.149175 Sep 09 02:06:20.222780 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 615/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:20 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:21.245150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:21.245759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:21.247564 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell0:SELECT=6 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:21.253800 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:21.254276 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:21.254705 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:21.255380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:21.255824 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:21.256237 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:21.387350 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:21.395150 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6162d0a2-f7f2-4f48-b965-31dd92bbac90 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.153947 Sep 09 02:06:21.395726 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 657/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:21 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:22.417971 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:22.418616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:22.425947 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:22.426722 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:22.432891 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:22.438953 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:22.439750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:22.440219 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:22.440822 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:22.442498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:22.442973 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:22.443402 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:22.454941 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] Creating event network-changed:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:06:22.458448 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR oslo.messaging._drivers.impl_rabbit [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] [457b0d05-b7d6-4ede-86c3-84f2f36ffc02] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 02:06:22.639198 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:22.646837 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-4ef5aed9-752e-466c-8072-20de438a4798 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.232856 Sep 09 02:06:22.647411 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 658/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:22 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:06:23.466028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO oslo.messaging._drivers.impl_rabbit [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] [457b0d05-b7d6-4ede-86c3-84f2f36ffc02] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 45798. Sep 09 02:06:23.469689 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-b171ca20-1aab-4ef2-a705-eacc5b907b7b req-777bc76b-7df4-4305-8cf9-15a0391b54fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.162592 Sep 09 02:06:23.470293 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 616/1274] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:23.671769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:23.672389 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:23.679552 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:23.680050 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:23.680490 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:23.681340 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:23.681801 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:23.682226 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:23.816324 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:23.824482 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-909453c5-0318-4bcc-9a8b-f1f09a18ac6b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.158726 Sep 09 02:06:23.825051 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 659/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:23 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:24.848902 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:24.849662 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:24.855721 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:24.856196 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:24.856623 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:24.857353 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:24.857800 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:24.858216 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:24.984282 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:24.992082 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f3865549-6859-4255-9453-72773952c052 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.148106 Sep 09 02:06:24.992639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 617/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:24 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:26.015453 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:26.016144 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:26.022594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:26.023075 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:26.023511 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:26.024197 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:26.024652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:26.025101 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:26.157475 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:26.165094 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e2eeceea-83c6-4fc7-92e2-c68d64b6fb8b tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.153967 Sep 09 02:06:26.165652 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 660/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:26 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:27.188022 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:27.188594 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:27.195046 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:27.195523 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:27.195955 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:27.196628 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:27.197085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:27.197507 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:27.326175 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:27.334143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-9ca7cf5c-7303-43fb-8aab-fac14b0ae106 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.150465 Sep 09 02:06:27.335250 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 618/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:27 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:28.359040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:28.359967 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:28.369630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:28.370355 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:28.371008 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:28.372039 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:28.372737 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:28.373409 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:28.502707 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:28.510185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9aa4f9a6-84d6-4d09-b9c5-7d0acf9190b1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.156852 Sep 09 02:06:28.510747 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 661/1279] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:28 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:28.893306 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "name": "network-vif-plugged", "status": "completed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:28.902729 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:28.903201 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:28.903627 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:28.914206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] Creating event network-vif-plugged:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:06:28.919143 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-63e1030f-7f2e-40b1-a2b7-82998e20422b req-6fde219c-1a13-4f71-808e-1d0e0d9a8737 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136364 Sep 09 02:06:28.920236 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 619/1280] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:29.535104 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:29.535662 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:29.542089 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:29.542578 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:29.543020 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:29.543709 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:29.544165 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:29.545177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:29.668918 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:29.676903 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e5fe77e5-8ec0-43e2-9cbe-0148a15eb1a2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1358 microversion: 2.1 time: 0.145768 Sep 09 02:06:29.677502 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 662/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:29 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:30.701084 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:30.701794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:30.707916 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:30.708394 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:30.708824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:30.709534 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:30.709985 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:30.710405 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:30.835474 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:30.843829 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-4804aca3-dec9-42a1-a262-14a6d700bc57 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1547 microversion: 2.1 time: 0.147703 Sep 09 02:06:30.844392 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 620/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:30 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:30.866413 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:30.867018 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:30.874563 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:30.875041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:30.875467 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:30.876149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:30.876594 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:30.877703 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:31.011963 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:31.019698 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9b507ce3-b52c-47d1-9957-a9aceff41de5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1547 microversion: 2.1 time: 0.157142 Sep 09 02:06:31.020280 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 663/1283] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:30 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:31.041274 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:31.046718 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:31.047471 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Searching by: {'deleted': False, 'project_id': 'eab48d377890454abfabbfa3053eaa57'} {{(pid=126896) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 02:06:31.053899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:31.054369 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:31.054793 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:31.055498 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:31.055945 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:31.056358 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:31.145194 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.multi_cell_list [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126896) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 02:06:31.237212 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-d0a6ce6b-3626-46ac-891c-6e27ad6f0519 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199455 Sep 09 02:06:31.237710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 621/1284] 10.222.0.15 () {58 vars in 1125 bytes} [Fri Sep 9 02:06:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:31.249170 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:31.249791 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:31.255736 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:31.256217 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:31.256657 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:31.257380 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:31.257836 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:31.258261 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:31.384733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:31.392789 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-bf1c5516-6b4b-4ad6-9b1b-288b9992d7e5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1547 microversion: 2.1 time: 0.147477 Sep 09 02:06:31.393379 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 664/1285] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:31 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:32.939704 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17f5dcf1-b5f1-4766-9979-09e51e419c61"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:32.942023 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:32.947948 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:32.948426 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:32.948854 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:32.949564 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:32.950013 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:32.950923 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:33.208824 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-5b4d53fa-67cb-423e-859e-4637421492ec tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273311 Sep 09 02:06:33.209532 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 622/1286] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Sep 9 02:06:32 2022] POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:40.799001 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:40.799607 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:40.802026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:40.807348 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:40.807819 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:40.808248 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:40.808921 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:40.809396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:40.809812 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:40.814979 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=73 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:40.941138 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:40.949370 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-6b00e876-6420-466e-8a2a-2d2609c56c67 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1593 microversion: 2.1 time: 0.154048 Sep 09 02:06:40.950069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 665/1287] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:40 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:42.863938 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:42.871536 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell0:SELECT=2 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:42.872286 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:42.878452 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:42.879071 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:42.879587 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:42.884910 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:06:42.899305 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] Creating event network-changed:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:06:42.905420 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-a25ad10e-7110-424c-bd15-db0e32156e88 req-ee4f191b-009a-4730-afb9-9ce7512d930f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046014 Sep 09 02:06:42.906384 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 623/1288] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:06:44.101327 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-914630493"}} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:44.102025 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:44.108396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:44.108396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:44.109582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:44.110275 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:44.110715 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:44.111130 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:44.240522 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.network.security_group_api [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Adding security group 45ebda59-99ea-488a-a96b-96d970b160bd to port ac86b608-d45d-48de-bb92-63d3e010095e Sep 09 02:06:44.544930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ed6f6be5-7d15-4c51-8acb-990982496f31 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.448046 Sep 09 02:06:44.545775 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 666/1289] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 02:06:44 2022] POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 02:06:44.554757 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:06:44.555503 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:06:44.562998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:44.563670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:44.564114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:44.564812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:44.565289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:44.565710 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:44.715401 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:06:44.723543 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f7e20ea2-adeb-402c-970b-22c7aa3564dd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1757 microversion: 2.1 time: 0.173646 Sep 09 02:06:44.724102 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 624/1290] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:06:44 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:06:44.923857 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:06:44.933560 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:06:44.934035 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:06:44.934461 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:06:44.946319 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] Creating event network-changed:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:06:44.952124 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-82b39a52-bfe6-4a1e-8b0d-42c05a1b7948 req-64b46dbc-f48d-481d-afc9-9e8492e48cce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Sep 09 02:06:44.952733 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 667/1291] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:07:45.180428 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=3 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:07:45.181114 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=7 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:07:45.185610 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:07:45.187859 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:45.194504 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:45.194984 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:45.195417 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:45.196105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:45.196558 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:45.196978 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:45.266058 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-392f3674-90b7-4c05-8a51-36b07a1cf0a4 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.087163 Sep 09 02:07:45.266670 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 625/1292] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 02:07:45 2022] POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 02:07:45.273200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=5 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:07:45.274038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=11 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:07:45.278421 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:45.279149 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:45.286093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:45.286577 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:45.287041 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:45.287711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:45.288169 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:45.288593 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:45.521888 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:45.530093 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-5ad2684d-3a1e-4ee9-acb1-11e8ff0972b5 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1749 microversion: 2.1 time: 0.258904 Sep 09 02:07:45.530667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 668/1293] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:45 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 02:07:46.554871 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:46.555483 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:46.562103 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:46.562581 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:46.563009 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:46.563691 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:46.564172 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:46.564592 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:46.704708 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:46.712763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-696b26bd-9660-4629-8ac2-eab0cbef5f7d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.162744 Sep 09 02:07:46.713362 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 626/1294] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:46 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:47.736065 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:47.736710 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:47.743151 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:47.743635 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:47.744069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:47.744750 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:47.745295 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:47.745759 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:47.885582 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:47.894142 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-c9a85eff-091f-4e27-948d-2f31b5ecabb2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.162205 Sep 09 02:07:47.894711 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 669/1295] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:47 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:48.919391 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:48.920036 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:48.926206 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:48.926686 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:48.927121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:48.927812 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:48.928262 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:48.928680 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:49.158714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:49.166840 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-39548278-7670-46ab-b3bf-4e93dbd42113 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.251786 Sep 09 02:07:49.167423 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 627/1296] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:48 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:50.190667 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:50.191265 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:50.198354 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:50.198829 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:50.199256 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:50.199931 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:50.200412 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:50.200827 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:50.337809 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:50.346424 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-e25656f7-bcf5-4323-ac70-ceadb86b108d tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.159616 Sep 09 02:07:50.346997 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 670/1297] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:50 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:51.369957 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:51.370576 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:51.377600 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:51.378085 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:51.378521 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:51.379208 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:51.379664 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:51.380086 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:51.524993 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:51.533144 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-2b1c5dc2-d0e7-4e22-8855-8aa78c8e0144 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.167047 Sep 09 02:07:51.533714 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 628/1298] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:51 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:52.555990 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:52.556581 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:52.563410 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:52.563930 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:52.564362 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:52.565038 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:52.565508 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:52.565926 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:52.704627 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:52.713443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-2f2766a0-b39b-450b-a406-ff99057fdd7c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.161517 Sep 09 02:07:52.714028 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 671/1299] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:52 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:53.736309 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:53.736954 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:53.743378 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:53.743862 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:53.744294 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:53.744998 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:53.745479 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:53.745899 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:53.884761 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:53.893560 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-f09b5b74-979a-4eed-aed4-1f7fb8aaa90c tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.161317 Sep 09 02:07:53.894128 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 629/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:53 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:54.917095 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:54.917721 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:54.925332 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:54.925816 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:54.926253 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:54.926942 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:54.927396 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:54.927818 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:55.065630 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:55.073603 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9891ac2e-20ff-4898-b3dc-0fa42cc17dc9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.160417 Sep 09 02:07:55.074172 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 672/1301] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:54 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:56.096920 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:56.097620 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:56.104158 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:56.104639 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:56.105083 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:56.105792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:56.106777 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:56.107222 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:56.249105 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:56.257131 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-b7f30c1b-54fd-4a72-8130-683f8954861e tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1754 microversion: 2.1 time: 0.164054 Sep 09 02:07:56.257705 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 630/1302] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:56 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:07:57.279838 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:07:57.280443 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:07:57.287105 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:57.287638 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:57.288069 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:57.288802 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:07:57.289345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:07:57.289713 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:07:57.671401 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:07:57.679479 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-10a06838-6d9f-4a08-931d-e842630c55c8 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1757 microversion: 2.1 time: 0.403663 Sep 09 02:07:57.680043 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 673/1303] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:07:57 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1757 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:09:01.004752 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_api:SELECT=12 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:09:01.005524 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG dbcounter [-] [126896] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:09:01.011794 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-914630493"}} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:09:01.012324 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:01.019383 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:01.019868 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:01.020299 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:01.020983 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:01.021458 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:01.021879 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:01.256541 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.network.security_group_api [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Removing security group 45ebda59-99ea-488a-a96b-96d970b160bd from port ac86b608-d45d-48de-bb92-63d3e010095e Sep 09 02:09:01.575056 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-691aeb2a-bb3b-4b5e-acf4-a487835ac8f6 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.571999 Sep 09 02:09:01.575759 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 631/1304] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Sep 9 02:09:01 2022] POST /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 02:09:01.580871 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_api:SELECT=12 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:09:01.581885 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG dbcounter [-] [126895] Writing DB stats nova_cell1:SELECT=36 {{(pid=126895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 02:09:01.586575 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:09:01.600289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:01.600756 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:01.601296 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:01.618077 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] Creating event network-changed:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:09:01.623689 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-ae0fc335-35f0-4d23-bc3c-36bfd03eb17e req-bebef12e-21a7-41a0-9be9-d19f26aa70f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044256 Sep 09 02:09:01.624985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 674/1305] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:09:02.624035 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:02.624631 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:02.631325 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:02.631821 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:02.632259 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:02.632966 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:02.633455 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:02.633876 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:02.692057 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:09:02.702474 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:02.703032 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:02.703532 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:02.715688 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.compute.server_external_events [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] Creating event network-changed:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:09:02.722135 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [req-9c30c070-89f7-46af-922a-29efecb120e1 req-f95ef708-a8a3-4467-8fb8-ded386a56395 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099615 Sep 09 02:09:02.722852 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 675/1306] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:09:02.734767 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.objects.instance [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lazy-loading 'services' on Instance uuid b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed {{(pid=126896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 02:09:02.813269 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-efcbbbfd-7945-47b2-8773-f3c5ff66c06f tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments/17f5dcf1-b5f1-4766-9979-09e51e419c61" status: 202 len: 0 microversion: 2.1 time: 0.194359 Sep 09 02:09:02.814982 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 632/1307] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 02:09:02 2022] DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments/17f5dcf1-b5f1-4766-9979-09e51e419c61 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 02:09:02.825806 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:02.828937 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:02.838040 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:02.838528 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:02.838961 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:02.839663 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:02.840121 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:02.840540 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:02.874602 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-9fb8f580-35b5-4bb8-a52f-50a3d0aa71fe tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055475 Sep 09 02:09:02.875345 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 676/1308] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 02:09:02 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 02:09:03.889943 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:03.893101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:03.900062 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:03.900556 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:03.901008 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:03.901733 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:03.903313 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:03.903763 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:03.935637 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-091e6d5d-55fe-448d-ae16-7b71ac89bcb1 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051893 Sep 09 02:09:03.936193 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 633/1309] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Sep 9 02:09:03 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 02:09:03.946694 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:03.947210 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:03.954200 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:03.954680 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:03.955108 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:03.955784 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:03.956229 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:03.956642 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:04.153417 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] HTTP exception thrown: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed is not attached to volume 17f5dcf1-b5f1-4766-9979-09e51e419c61 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Request method failure captured: Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments/17f5dcf1-b5f1-4766-9979-09e51e419c61 HTTP/1.1 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp-B4xOqE8mAdXozcn8MdRh9Up3J2bcoMN6qZ3Wqsgpw6Lk5Ccv0pPcKXeKszhnIj9bDf49RBmHQjAaqN8f1ivMz2GB2fbQPi1foJV3olLXMnD3MW8eHvNMKuz2AQWKdm6bMMXR09o7pndJNe3idxnexmv8sS9FaaDH2EjO9jrdmK_g Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: eab48d377890454abfabbfa3053eaa57 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:09:04.155771 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eab48d377890454abfabbfa3053eaa57", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: eab48d377890454abfabbfa3053eaa57 Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestMinimumBasicScenario-1944809396-project Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 4d5be7be998f438d8ecb854412d7dbf5 Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestMinimumBasicScenario-1944809396-project Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:09:04.157985 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed is not attached to volume 17f5dcf1-b5f1-4766-9979-09e51e419c61 Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'server_id': 'b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed', 'id': '17f5dcf1-b5f1-4766-9979-09e51e419c61'} Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 17f5dcf1-b5f1-4766-9979-09e51e419c61. Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:09:04.159026 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed is not attached to volume 17f5dcf1-b5f1-4766-9979-09e51e419c61 Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed is not attached to volume 17f5dcf1-b5f1-4766-9979-09e51e419c61 Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:04.160685 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Returning 404 to user: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed is not attached to volume 17f5dcf1-b5f1-4766-9979-09e51e419c61 {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:09:04.161972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-97970444-0eb4-41a2-9791-372c4c326997 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments/17f5dcf1-b5f1-4766-9979-09e51e419c61" status: 404 len: 154 microversion: 2.1 time: 0.214478 Sep 09 02:09:04.161972 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 677/1310] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Sep 9 02:09:03 2022] DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed/os-volume_attachments/17f5dcf1-b5f1-4766-9979-09e51e419c61 => generated 154 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:09:05.294028 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:05.294513 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:05.300758 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:05.301289 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:05.301727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:05.302410 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:05.302872 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:05.303296 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:05.327010 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Going to try to terminate instance {{(pid=126896) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 02:09:05.400101 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-812b308a-a38f-4d83-b80f-898dbe011dcd tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 204 len: 0 microversion: 2.1 time: 0.109996 Sep 09 02:09:05.400722 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 634/1311] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Sep 9 02:09:05 2022] DELETE /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 02:09:05.410214 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:05.410832 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:05.418456 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:05.419177 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:05.419830 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:05.420913 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:05.421650 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:05.422289 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:05.556556 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:09:05.565185 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-ad4d3bc2-be36-4534-beec-64a56a54b6f2 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1553 microversion: 2.1 time: 0.159200 Sep 09 02:09:05.565769 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 678/1312] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:09:05 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:09:06.588745 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:06.589475 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.compute.api [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126896) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:06.595918 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:06.596402 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:06.597275 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:06.597969 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:06.598425 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:06.598848 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:06.728004 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.policy [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126896) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:09:06.736727 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-91e12371-2f75-40e2-be50-5735ad545549 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1553 microversion: 2.1 time: 0.152239 Sep 09 02:09:06.737316 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 635/1313] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:09:06 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:09:07.759869 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:07.761082 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:07.767518 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:07.767994 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:07.768420 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:07.769115 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:07.769569 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:07.769984 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:07.963545 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.policy [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5be7be998f438d8ecb854412d7dbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab48d377890454abfabbfa3053eaa57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126895) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 02:09:07.971512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-b16889e3-2245-4161-8ebd-98db3652ac17 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 200 len: 1553 microversion: 2.1 time: 0.215578 Sep 09 02:09:07.972116 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 679/1314] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:09:07 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 02:09:08.075847 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed", "name": "network-vif-deleted", "tag": "ac86b608-d45d-48de-bb92-63d3e010095e"}]} {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 02:09:08.086121 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:08.086589 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:08.087005 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG oslo_concurrency.lockutils [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:08.099648 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.compute.server_external_events [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] Creating event network-vif-deleted:ac86b608-d45d-48de-bb92-63d3e010095e for instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed on hv-cinder-85221 Sep 09 02:09:08.105562 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [req-bf473412-36a8-4831-b31c-4f1185cd3878 req-40ac5782-6189-4ec6-885b-bc1f2448dbc5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Sep 09 02:09:08.106146 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 636/1315] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Sep 9 02:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 02:09:08.995964 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '>' {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:08.996578 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.compute.api [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [instance: b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed] Fetching instance by UUID {{(pid=126895) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 02:09:09.003031 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:09.003512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:09.003941 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:09.004621 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Acquiring lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 02:09:09.005088 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 02:09:09.005512 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG oslo_concurrency.lockutils [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Lock "43400d51-3c7d-455c-8c25-cdb5e9eccfe4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 02:09:09.019385 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.wsgi [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] HTTP exception thrown: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Request method failure captured: Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: request: GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed HTTP/1.1 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept: application/json Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Accept-Encoding: identity Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Connection: close Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Length: 0 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Content-Type: application/json Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Host: 10.222.0.15 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: Openstack-System-Scope: None Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: User-Agent: python-urllib3/1.26.12 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Auth-Token: gAAAAABjGp-B4xOqE8mAdXozcn8MdRh9Up3J2bcoMN6qZ3Wqsgpw6Lk5Ccv0pPcKXeKszhnIj9bDf49RBmHQjAaqN8f1ivMz2GB2fbQPi1foJV3olLXMnD3MW8eHvNMKuz2AQWKdm6bMMXR09o7pndJNe3idxnexmv8sS9FaaDH2EjO9jrdmK_g Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Id: None Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Domain-Name: None Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Identity-Status: Confirmed Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Is-Admin-Project: True Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Id: default Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Domain-Name: Default Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Id: eab48d377890454abfabbfa3053eaa57 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Project-Name: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Role: reader,member Sep 09 02:09:09.020929 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Roles: reader,member Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eab48d377890454abfabbfa3053eaa57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eab48d377890454abfabbfa3053eaa57", "adminURL": "http://10.222.0.15:8080"}]}] Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Id: eab48d377890454abfabbfa3053eaa57 Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1944809396 Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User: tempest-TestMinimumBasicScenario-1944809396-project Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Id: default Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Domain-Name: Default Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Id: 4d5be7be998f438d8ecb854412d7dbf5 Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: X-User-Name: tempest-TestMinimumBasicScenario-1944809396-project Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: method: > Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: exception: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. Sep 09 02:09:09.022743 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: action_args: {'id': 'b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed'} Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: {{(pid=126895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 02:09:09.023616 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. Sep 09 02:09:09.025255 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: ERROR nova.api.openstack.wsgi Sep 09 02:09:09.027183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: DEBUG nova.api.openstack.wsgi [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Returning 404 to user: Instance b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed could not be found. {{(pid=126895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 02:09:09.027183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: INFO nova.api.openstack.requestlog [None req-8b7dd689-a65f-4c0a-9ffd-20d44e5b27f9 tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed" status: 404 len: 111 microversion: 2.1 time: 0.030682 Sep 09 02:09:09.027183 dv-cinder-852210-12-iscsi devstack@n-api.service[126895]: [pid: 126895|app: 0|req: 680/1316] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Sep 9 02:09:08 2022] GET /compute/v2.1/servers/b3f5d7fa-e2f5-4e4c-b88d-2a401faaa6ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 02:09:09.031792 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: DEBUG nova.api.openstack.wsgi [None req-0230a418-d3a2-4372-8acd-707603f292ae tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] Calling method '.version_select at 0x7f87d88535e0>' {{(pid=126896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 02:09:09.036044 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0230a418-d3a2-4372-8acd-707603f292ae tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [2789f481-e9bf-4c7a-a714-eff8a3b3d19c] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 02:09:10.042657 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO oslo.messaging._drivers.impl_rabbit [None req-0230a418-d3a2-4372-8acd-707603f292ae tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] [2789f481-e9bf-4c7a-a714-eff8a3b3d19c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 46034. Sep 09 02:09:10.060590 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: INFO nova.api.openstack.requestlog [None req-0230a418-d3a2-4372-8acd-707603f292ae tempest-TestMinimumBasicScenario-1944809396 tempest-TestMinimumBasicScenario-1944809396-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1869241803" status: 202 len: 0 microversion: 2.1 time: 1.032920 Sep 09 02:09:10.061198 dv-cinder-852210-12-iscsi devstack@n-api.service[126896]: [pid: 126896|app: 0|req: 637/1317] 10.222.0.15 () {58 vars in 1272 bytes} [Fri Sep 9 02:09:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1869241803 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)